-- Logs begin at Wed 2022-07-27 07:45:52 UTC, end at Wed 2022-07-27 08:56:34 UTC. -- Jul 27 08:19:18.181407 dv-cinder-851170-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 08:19:18.189197 dv-cinder-851170-2-smb devstack@keystone.service[80315]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 08:19:18 2022] *** Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: nodename: dv-cinder-851170-2-smb Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: machine: x86_64 Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: clock source: unix Jul 27 08:19:18.191189 dv-cinder-851170-2-smb devstack@keystone.service[80315]: pcre jit disabled Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: detected number of CPU cores: 4 Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: current working directory: / Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: detected binary path: /usr/bin/uwsgi-core Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: your processes number limit is 47680 Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: your memory page size is 4096 bytes Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: detected max file descriptor number: 2048 Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: lock engine: pthread robust mutexes Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: thunder lock: enabled Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 08:19:18.191648 dv-cinder-851170-2-smb devstack@keystone.service[80315]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 08:19:18.231220 dv-cinder-851170-2-smb devstack@keystone.service[80315]: Python main interpreter initialized at 0x5615bdf299c0 Jul 27 08:19:18.231220 dv-cinder-851170-2-smb devstack@keystone.service[80315]: python threads support enabled Jul 27 08:19:18.231220 dv-cinder-851170-2-smb devstack@keystone.service[80315]: your server socket listen backlog is limited to 100 connections Jul 27 08:19:18.231220 dv-cinder-851170-2-smb devstack@keystone.service[80315]: your mercy for graceful operations on workers is 90 seconds Jul 27 08:19:18.231597 dv-cinder-851170-2-smb devstack@keystone.service[80315]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 08:19:18.231719 dv-cinder-851170-2-smb devstack@keystone.service[80315]: *** Operational MODE: preforking *** Jul 27 08:19:18.231997 dv-cinder-851170-2-smb devstack@keystone.service[80315]: *** uWSGI is running in multiple interpreter mode *** Jul 27 08:19:18.231997 dv-cinder-851170-2-smb devstack@keystone.service[80315]: spawned uWSGI master process (pid: 80315) Jul 27 08:19:18.232193 dv-cinder-851170-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 08:19:18.232829 dv-cinder-851170-2-smb devstack@keystone.service[80315]: spawned uWSGI worker 1 (pid: 80326, cores: 1) Jul 27 08:19:18.233719 dv-cinder-851170-2-smb devstack@keystone.service[80315]: spawned uWSGI worker 2 (pid: 80327, cores: 1) Jul 27 08:19:18.235810 dv-cinder-851170-2-smb devstack@keystone.service[80315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 08:19:23.744417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:19:23.744417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: from cryptography.utils import int_from_bytes Jul 27 08:19:23.745284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:19:23.745284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: from cryptography.utils import int_from_bytes Jul 27 08:19:23.794939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:19:23.795091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:19:23.795431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] command line args: [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:19:23.795718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:19:23.795903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ================================================================================ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:19:23.796162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] admin_token = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.796418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] config_dir = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.796620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.796832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] config_source = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.797017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] debug = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.797220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.797715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.797823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.798036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.798292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.798530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.798717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_config_append = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.798899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.799106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_dir = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.799259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.799501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.799752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.800007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.800258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.800440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.800622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.800900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.801154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.801395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.801635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.801878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.802118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.802372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.802623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.802914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.803425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.803613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] publish_errors = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.803852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.804092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.804275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.804529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.804793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.805039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] standard_threads = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.805276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.805526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.805707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.805887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] use_journal = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.806067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] use_json = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.806245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] use_stderr = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.806424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] use_syslog = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.806661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.806923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.807168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.807433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.807678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.807933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.808178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.808431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.808673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.808953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.809207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.809464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.809706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.809958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.810199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.810451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.810706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.811561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.811731 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.811993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.812246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.812493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.812773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.813045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.813304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.813559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.813796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.814035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.814272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.814513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.814766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.815018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.815255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.815491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.815741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.815993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.816236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.816487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.816734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.816991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.817244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.817482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.817719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.817955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.818190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.818432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.818685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.818921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.819162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.819399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.819639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.819878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.820129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.820364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.820438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:19:23.820438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: from cryptography.utils import int_from_bytes Jul 27 08:19:23.820949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.821020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:19:23.821020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: from cryptography.utils import int_from_bytes Jul 27 08:19:23.821218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.821218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.821349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.821551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.821785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.822038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.822284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.822527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.822763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.823026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.823269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.823504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.823746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.823986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.824257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.824503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.824777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.825029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.825273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.825515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.825755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.826007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.826251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.827094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.827342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.827674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.827926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.828167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.828410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.828653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.828957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.829218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.829466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.829710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.829958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.830200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.830443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.830686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.830923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.831158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.831394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.831635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.831872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.832118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.832363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.832617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.832887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.833151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.833427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.833673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.833912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.external = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.834149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.834450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.834688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.834925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.password = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.835161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.token = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.835407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.835647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.837444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.837716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.837996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.838270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.838522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.838775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.839039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.839305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.839595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.839849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.840111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.840359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.840635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.840927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.841177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.841440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.841733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.842035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.842512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.842913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.843186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.843435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.843685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.843943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.844200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.844451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.844708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.844983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.845248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.845513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.845762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.846009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.846267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.846513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.846769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.847024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.847268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.847519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.847770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.848008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.848254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.848511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.848797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.849041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.849282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.849522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.849776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.850032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.850287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.850558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.850803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.851096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.851331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.851577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.851818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.852065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.852327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.852553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.852830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.853078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.853335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.853575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.853831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.854084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.854325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.854578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.854830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.855068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.855313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.855551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.855796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.856041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.856292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.856537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.856803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.857061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.857316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.857552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.857836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.858224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.858480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.858724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.858965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.859206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.859443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.859689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.859954 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.860192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.860446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.860698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.860974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.861214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.861450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.861689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.861930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.862173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.862408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.862665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.862917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.863169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.863421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.863670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.863905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.864158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.864401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.864643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.864919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.865163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.865416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.865670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.865915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.866176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.866415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.866665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.866909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.867150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.867394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.867647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.867895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.868107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:19:23.868193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.868306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:19:23.868398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.868484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] command line args: [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:19:23.868599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.868790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:19:23.868871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.868978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ================================================================================ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:19:23.869120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.869238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] admin_token = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.869363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.869489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config_dir = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.869618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.869695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.869852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] config_source = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.869929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.870033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] debug = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.870116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.870247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.870358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.870487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.870565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.870666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.870804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.870919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.871046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] role.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.871170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.871298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] role.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.871404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.871534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.871611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_config_append = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.871749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.871852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.871938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_dir = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.872020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.872092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.872269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.872354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.872520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.872606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.872807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.872890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.873054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.873134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.873216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.873918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.873997 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.874167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.874314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.874416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.874561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.874638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.874817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.874894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.875071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.875149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.875318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.875394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.875566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.875642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.875811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.875990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.876075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.876234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.876489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.876567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.876749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] publish_errors = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.876842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.876999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.877077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.877233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.877310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.877412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.877490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.877659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.877743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.877897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.877974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.878133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] standard_threads = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.878211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.878368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.878451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.878614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.878691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.878836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.878910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.878980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_journal = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.879117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_json = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.879193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.879295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_stderr = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.879379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.879471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] use_syslog = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.879616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.879694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:19:23.879860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.879936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.880951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.881924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.882910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.883864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.884860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.885880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.886984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.887936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.888756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.889591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.889680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.889843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.889927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.890085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.890162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.890275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:19:23.890353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.890542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.890776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.891009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.891514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.891766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.891999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.892238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.892471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.892710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.892968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.893217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.893451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.893690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.893929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.894168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.894407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.894648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.894881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.895132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.895369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.895609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.895845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.896108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.896348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.896582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.896849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.897088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.897362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.897606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.897855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.898107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.898346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.898585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.898823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.899078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.899321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.899567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.899814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.900055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.900297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.900539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.900801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.901043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.901315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.901563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.901809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.902053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.902299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.902542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.902783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.903024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.903260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.903496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.903731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.903973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.904209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.904456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.904928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.905337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.905605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.905870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.906140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.906386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.906621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.external = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.906857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.907159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.907397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.907632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.password = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.907869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] auth.token = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.908114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.908357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.908611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.908870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.909125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.909382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.909620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.909861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.910111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.910364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.910615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.910856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.911105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.911344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.911614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.911870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.912111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.912367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.912660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.912939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.913211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.913459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.913720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.913959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.914211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.914461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.914710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.914944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.915196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.915442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.915701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.915942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.916201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.916441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.916705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.916970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.917221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.917471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.917713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.917952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.918204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.918439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.918680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.918932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.919188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.919425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.919666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.919903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.920201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.920492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.920769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.921028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.921279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.921542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.921784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.922025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.922263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.922504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.922739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.922980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.923227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.923471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.923723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.923958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.924210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.924460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.924700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.924973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.925222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.925456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.925698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.925933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.926175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.926416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.926668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.926910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.927151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.927404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.927655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.927892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.928126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.928378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.928626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.928894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.929136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.929376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.929618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.929865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.930129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.930366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.930616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.930868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.931115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.931355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.931589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.931827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.932064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.932303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.932536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.932809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.933061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.933310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.933561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.933810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.934044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.934300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.934541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.934783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.935023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.935260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.935509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.936296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.936671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.936961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.937201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.937452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.937694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.937935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.938177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.938581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.938835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.939077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.939322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.939571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.939834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.940095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.940341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.940595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.940876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.941120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.941372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.941613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.941860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.942102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.942354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.942590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.942843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.943095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.943347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.943597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.943846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.944095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.944343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.944592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.944852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.945105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.945356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.945606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.945856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.946316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.946556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.946808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.947060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.947406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.947564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.947802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.948062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.948317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.948558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.948819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.949056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.949292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.949547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.949806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.950061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.950302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.950542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.950779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.951019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.951260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.952141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.952387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.952784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.953072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.953275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.953522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.953770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.954021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.954261 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.954504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.954740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.954989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.955239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.955473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.955721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.956021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.956286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.956536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.956806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.957049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.957295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.957535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.957776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.958013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.958251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.958499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.958738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.958983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.959221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.959471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.959711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.959958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.960197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.960441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.960681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:19:23.960878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:19:23.991917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:23.992144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:23.992372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:23.998803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:23.999086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:23.999321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.000995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.007887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.046443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.046590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.046670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.046746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.099171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.100355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.149002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.149237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.149833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.150068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.215450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.215678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.215903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.216129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.216349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.216567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.218208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.218473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.218689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.218898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.219091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.219299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.240301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.240534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.240786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.240880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.241898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.242117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.252791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.253189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.266366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.266612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.266695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.266839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.266921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.267917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80327) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:19:24.285576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.285793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:19:24.285891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.286066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:19:24.286146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.286317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:19:24.286396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.286586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:19:24.286667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.286847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.286927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.287103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.287182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.287360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.287439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.287615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.297159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.297398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.297558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.297669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.297833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.298070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.298150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.298365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.305055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.305278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.308023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.308308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.308597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.308914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.309313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.309582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.309859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.309937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.310142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.310223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.310421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.310499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.310732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.310877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.311018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.311198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.311462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.311728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.312000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.312271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.312544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.312836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.335171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.336158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.336666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.336990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.337666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.337946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.341864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.342733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.343019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.343231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.343507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.343784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.349746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.350031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.350425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.350709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.354296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.354590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.354813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.354894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.355940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.356019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.356216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.356303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.356580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.356900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.372395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.372675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.372909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.373198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.377294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.378121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.380428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.380755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.381326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.381626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.385120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.385924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.388286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.389798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.392354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.392649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.392958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.393255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.393336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.393543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.393625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.393828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.393910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.394135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.394421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.394718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.410428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.410708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.410977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.411239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.411319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.411587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.411860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.412124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.418150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.419190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.419687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.419963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.420935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.421214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.422841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.423121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.423419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.423701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.423928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.424010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.424214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.424510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.424943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.425250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.435410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.435690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.436002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.436363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.436641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.436752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.436946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.437027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.437229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.437310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.437613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.437910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.438195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.438491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.453412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.454787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.456351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.457803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.459411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.460805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.461886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.462290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.463430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.463715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.463930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.464012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.464219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.464502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.470523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.471363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.472108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.472885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.475040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.475328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.475610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.475881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.476003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.476238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.476526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.476848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.484483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.484786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.485067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.485631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.485922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.486207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.491918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80327) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.492199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.492476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.492774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.493055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.493277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:19:24.493358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.493561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.493641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.493834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.493913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.494967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.495046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.495235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.495323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.495508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.495589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80327) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.495787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.496073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.496339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.496617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.496898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:19:24.530085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615bdf299c0 pid: 80327 (default app) Jul 27 08:19:24.532789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615bdf299c0 pid: 80326 (default app) Jul 27 08:19:24.533477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f7fa-a03d-48b2-9ae8-a5a4cd638f5a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:24.533769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f7fa-a03d-48b2-9ae8-a5a4cd638f5a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:24.534043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f7fa-a03d-48b2-9ae8-a5a4cd638f5a None None] PATH_INFO: `/v3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:24.538372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Jul 27 08:19:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:32.892672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:32.893189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:32.893189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:32.897602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:32.902867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:32.903773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:32.903773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:32.974452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: INFO dbcounter [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] Registered counter for database keystone Jul 27 08:19:32.996392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:19:33.002623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writer thread running {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:19:33.182023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG passlib.handlers.bcrypt [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80327) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 08:19:33.182358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG passlib.handlers.bcrypt [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80327) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 08:19:33.236862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:33.238534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:33.363165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 08:19:33.496870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:33.566303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: INFO dbcounter [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] Registered counter for database keystone Jul 27 08:19:33.585915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG oslo_db.sqlalchemy.engines [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:19:33.592063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writer thread running {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:19:33.711302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59594d8f-37c4-4ef5-9b13-f323b77e07ab None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:33.715564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:33.716199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:33.716509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:33.716814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:33.724899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:33.776905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 08:19:33.777197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db981dd8-a241-4758-a17b-c4d57f1b961a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:33.786885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Jul 27 08:19:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:19:33.792906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:33.807175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac5fc-d541-41a9-ad85-aa86fd138a18 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:33.812225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:33.813351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:33.813636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:33.813907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] PATH_INFO: `/v3/projects/f286f6bca46449aebb8b762b4e1748f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:33.815387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=f286f6bca46449aebb8b762b4e1748f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:33.866083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 08:19:33.866435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d09f-ad9e-45a1-9822-a19feab6d4f6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:33.871054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Jul 27 08:19:33 2022] GET /identity/v3/projects/f286f6bca46449aebb8b762b4e1748f9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:35.850523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6453a6-0635-4c04-9aa3-c3bbaf1f0d91 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:35.851059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6453a6-0635-4c04-9aa3-c3bbaf1f0d91 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:35.851059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6453a6-0635-4c04-9aa3-c3bbaf1f0d91 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:35.855135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:35.861045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:35.861480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:35.861673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:35.881550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:35.883083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:35.891256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 08:19:35.913461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6453a6-0635-4c04-9aa3-c3bbaf1f0d91 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:35.926151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6453a6-0635-4c04-9aa3-c3bbaf1f0d91 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:35.930378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a7a69-db4f-43f2-9b3c-9966ca4deed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:35.930990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a7a69-db4f-43f2-9b3c-9966ca4deed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:35.931281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a7a69-db4f-43f2-9b3c-9966ca4deed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:35.931564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a7a69-db4f-43f2-9b3c-9966ca4deed5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:35.939422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a7a69-db4f-43f2-9b3c-9966ca4deed5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:35.941225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a7a69-db4f-43f2-9b3c-9966ca4deed5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:35.949950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Jul 27 08:19:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:19:35.955279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:35.964599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ec4f-5b77-4e65-8348-b11712307e9c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:35.970014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91e663-a560-4014-9f55-52a74ac4394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:35.970661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e663-a560-4014-9f55-52a74ac4394c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:35.970948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e663-a560-4014-9f55-52a74ac4394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:35.971226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e663-a560-4014-9f55-52a74ac4394c admin admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:35.972597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e663-a560-4014-9f55-52a74ac4394c admin admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:35.974475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e663-a560-4014-9f55-52a74ac4394c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:35.976046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Jul 27 08:19:35 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:38.042996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97321d-c735-4887-9007-de914167c646 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.043529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97321d-c735-4887-9007-de914167c646 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.043529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97321d-c735-4887-9007-de914167c646 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.045593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:38.050753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733519-c71f-4710-b707-181e3f430a42 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.051147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733519-c71f-4710-b707-181e3f430a42 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.051314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733519-c71f-4710-b707-181e3f430a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.067533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032032c1-df01-4ce7-98b9-d69ecfe4376b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.067826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032032c1-df01-4ce7-98b9-d69ecfe4376b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.068111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032032c1-df01-4ce7-98b9-d69ecfe4376b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.069477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:19:38.070944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-88733519-c71f-4710-b707-181e3f430a42 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:38.072140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-88733519-c71f-4710-b707-181e3f430a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:38.074479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.074772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.075050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.117530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG passlib.handlers.bcrypt [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80326) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 08:19:38.117949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG passlib.handlers.bcrypt [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80326) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 08:19:38.151026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:38.163654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:38.165287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:38.174754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88733519-c71f-4710-b707-181e3f430a42 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.197622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:38.265850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:38.279451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88733519-c71f-4710-b707-181e3f430a42 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.287778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.313736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.314316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.314600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.314882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.326329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:38.335246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:38.336176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:19:38.337024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:19:38.342625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.393787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6dbfa-72bb-4f68-8930-49d20944d616 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.396040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:38.425687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:38.430346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.431259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.431546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.431823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.444101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7a5b1-44af-46da-804d-64785da58ec8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.479237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.479856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.480141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.480424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.481178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:38.481488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:38.483423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:38.495167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:38.499626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:38.501265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.501431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:38.599804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fcf54-f753-4042-b5b8-034b46d2e155 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.602479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:19:38.609246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.613472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:38.716101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b31d9-a401-479c-9c1c-0ff74850155c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.740397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.741074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.741357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.741628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.742807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:38.744256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:38.745880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:38.751251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.751870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.752107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.752391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.752662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.767131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:38.771112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:38.772565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:19:38.790277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:38.791103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:38.791885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:19:38.791885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:19:38.791885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:19:38.791885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:38.791885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:19:38.798448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.853860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712f2de-e8a4-43e8-9abd-36fe2f13a319 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.854486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:38.887511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.888214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.888682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.888989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.890144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:38.891850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:38.893457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:38.897121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308758b-f11d-49f1-be8f-4327e1946a85 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:38.899127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:38.931053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:38.931667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:38.931951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:38.932226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:38.932943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:38.933249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:38.934620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5cb68-d4e9-456b-9930-796f8be66850 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:38.952766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:38.984868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:39.005324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67b39-5130-4224-a6b9-f75a4e767692 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:39.043714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:39.044160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:39.045121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:39.046790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:39.047658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.domain.id=default, user.id=7ba1e3f431c1414c8f4830c4c446296d) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:39.047983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:39.049532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134263d-612f-4a1b-ada5-604cf6bd1e74 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:39.068840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Jul 27 08:19:38 2022] GET /identity/v3/role_assignments?user.id=7ba1e3f431c1414c8f4830c4c446296d&scope.domain.id=default&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:41.147005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff541c-8fd6-4b6f-b295-1215fadfbd07 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.147701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff541c-8fd6-4b6f-b295-1215fadfbd07 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.147701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff541c-8fd6-4b6f-b295-1215fadfbd07 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.148932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:41.154797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5beb2-59f4-48ed-a29b-ec229ecfc2ab None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.155306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5beb2-59f4-48ed-a29b-ec229ecfc2ab None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.155381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5beb2-59f4-48ed-a29b-ec229ecfc2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.189107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f7c5beb2-59f4-48ed-a29b-ec229ecfc2ab None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:41.190330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f7c5beb2-59f4-48ed-a29b-ec229ecfc2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:41.294210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:41.325097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff541c-8fd6-4b6f-b295-1215fadfbd07 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:41.457079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b75af-8593-44a1-bf67-09057fb2ad23 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.457422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b75af-8593-44a1-bf67-09057fb2ad23 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.457607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b75af-8593-44a1-bf67-09057fb2ad23 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.459229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:19:41.465473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2e85-652e-495a-9173-55ddf62d9c0f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.465735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2e85-652e-495a-9173-55ddf62d9c0f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.466019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2e85-652e-495a-9173-55ddf62d9c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.470600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff541c-8fd6-4b6f-b295-1215fadfbd07 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:41.495662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:41.505841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-937e2e85-652e-495a-9173-55ddf62d9c0f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:41.507073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-937e2e85-652e-495a-9173-55ddf62d9c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:41.541476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:41.542158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.542440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.542725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.569842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:41.571308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e2490292-220e-4536-bb05-31604431fd31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:19:41.599262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:41.600123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:41.600924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:19:41.600924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:19:41.600924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:19:41.600924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:41.602829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 12/25] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:41.608777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841962c8-05c7-4f62-a404-5520e95313c9 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.608777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841962c8-05c7-4f62-a404-5520e95313c9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.608777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841962c8-05c7-4f62-a404-5520e95313c9 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.613373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 13/26] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:41.614247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841962c8-05c7-4f62-a404-5520e95313c9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:41.666385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 14/27] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:41.669140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.669986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.670402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.690117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:41.709895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:41.711085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:41.805303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841962c8-05c7-4f62-a404-5520e95313c9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:41.847741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 15/28] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:41.848711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:41.881523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:41.882331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:41.882743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:41.883034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:41.884009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:41.884329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:41.886174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:41.907126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 14/29] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:41.908009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:41.951695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:42.013503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ae0a-c2e5-4433-aefd-511297668fce None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:42.033396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b95b5-49ed-4fdd-a2d0-6a536d2a2d4b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:42.059949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f92f6-9241-4fec-b566-b51b9adfdf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:42.061648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f92f6-9241-4fec-b566-b51b9adfdf67 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.062395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f92f6-9241-4fec-b566-b51b9adfdf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.062848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f92f6-9241-4fec-b566-b51b9adfdf67 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.064050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f92f6-9241-4fec-b566-b51b9adfdf67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:42.066519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f92f6-9241-4fec-b566-b51b9adfdf67 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:42.071866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:42.073866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:42.075216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.075736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.076241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.088624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:42.096145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:42.097168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:42.098009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:42.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 15/30] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:42.100007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:42.197571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:42.212491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f29eb-08e5-4e14-8715-b9b75e1ffa4b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:42.251658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:42.252342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.252685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.253000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.253889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:42.255426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:42.331729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 16/31] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Jul 27 08:19:41 2022] POST /identity/v3/roles => generated 219 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:42.333860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31db9-959a-4fe4-a0bd-0f52d36b0259 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.334365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31db9-959a-4fe4-a0bd-0f52d36b0259 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.334857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31db9-959a-4fe4-a0bd-0f52d36b0259 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.340787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 17/32] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:42.342530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31db9-959a-4fe4-a0bd-0f52d36b0259 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:42.548507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31db9-959a-4fe4-a0bd-0f52d36b0259 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:42.604418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:42.605019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.605309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.605590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.606343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:42.606663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:42.608888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15bf73-e54e-4f6a-ab26-e57dba03ed1c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:42.619906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 18/33] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:42.625570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.625862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.626150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.647348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:42.648929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:42.688443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 16/34] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:19:42 2022] POST /identity/v3/projects => generated 301 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:42.689270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:42.711040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:42.735520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 19/35] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:42.765932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:42.817794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2017b3-f9f0-46a8-890b-144decfa3dd1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:42.881653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce7402-089c-4c71-b106-e5f51b5a1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:42.882258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce7402-089c-4c71-b106-e5f51b5a1bab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.882543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce7402-089c-4c71-b106-e5f51b5a1bab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.882820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce7402-089c-4c71-b106-e5f51b5a1bab None admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.884433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce7402-089c-4c71-b106-e5f51b5a1bab None admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:42.886169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce7402-089c-4c71-b106-e5f51b5a1bab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:42.887968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 17/36] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:42 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:42.902279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed815f9d-fe80-40e4-aead-5c4437d42d87 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:42.909186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e11f5-a9c5-46ed-8fee-234cefaaa979 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.909729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e11f5-a9c5-46ed-8fee-234cefaaa979 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.909891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e11f5-a9c5-46ed-8fee-234cefaaa979 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.911165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 18/37] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:19:42.911858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e11f5-a9c5-46ed-8fee-234cefaaa979 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:42.926779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:42.944574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98950c6b-42a2-4b5d-b846-0f7ca95087ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:42.945295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98950c6b-42a2-4b5d-b846-0f7ca95087ad None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:42.945659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98950c6b-42a2-4b5d-b846-0f7ca95087ad None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:42.945958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98950c6b-42a2-4b5d-b846-0f7ca95087ad None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:42.946703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98950c6b-42a2-4b5d-b846-0f7ca95087ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:42.948105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98950c6b-42a2-4b5d-b846-0f7ca95087ad None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:43.026134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e11f5-a9c5-46ed-8fee-234cefaaa979 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:43.060766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 20/38] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Jul 27 08:19:42 2022] POST /identity/v3/roles => generated 225 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:19:43.060766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722c0b-32da-4d77-bdce-2e7b2626d833 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.060766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722c0b-32da-4d77-bdce-2e7b2626d833 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.060766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722c0b-32da-4d77-bdce-2e7b2626d833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.066559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c1d49-6203-4b66-9dea-2e60c59afe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:43.067252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c1d49-6203-4b66-9dea-2e60c59afe17 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.067539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c1d49-6203-4b66-9dea-2e60c59afe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.067818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c1d49-6203-4b66-9dea-2e60c59afe17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.070013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c1d49-6203-4b66-9dea-2e60c59afe17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:43.070571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c1d49-6203-4b66-9dea-2e60c59afe17 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:43.072230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 19/39] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:43.073529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e929-81a6-47e6-a0e9-aa7fde4a19d5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.073884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e929-81a6-47e6-a0e9-aa7fde4a19d5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.074218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e929-81a6-47e6-a0e9-aa7fde4a19d5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.076123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:43.081836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e929-81a6-47e6-a0e9-aa7fde4a19d5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:43.082064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-af722c0b-32da-4d77-bdce-2e7b2626d833 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:43.083316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af722c0b-32da-4d77-bdce-2e7b2626d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:43.134160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:43.166994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:43.168323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.168614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.168919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.179227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:43.190853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:43.192159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:43.208768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e929-81a6-47e6-a0e9-aa7fde4a19d5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:43.249719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:43.250404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.251763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.251763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] PATH_INFO: `/v3/domains/default/users/7ba1e3f431c1414c8f4830c4c446296d/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.253444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7ba1e3f431c1414c8f4830c4c446296d, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:43.255006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:43.273920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:43.274778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:43.329342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1361 bytes} [Wed Jul 27 08:19:43 2022] PUT /identity/v3/domains/default/users/7ba1e3f431c1414c8f4830c4c446296d/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:19:43.330374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:43.378214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ff181-b563-4355-8cad-b9a33c40d79a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:43.386468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:43.416627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719588d-d1eb-4b9a-a7ce-ce378d063a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:43.417300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719588d-d1eb-4b9a-a7ce-ce378d063a58 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.417589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719588d-d1eb-4b9a-a7ce-ce378d063a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.417867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719588d-d1eb-4b9a-a7ce-ce378d063a58 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.418599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719588d-d1eb-4b9a-a7ce-ce378d063a58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:43.420586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719588d-d1eb-4b9a-a7ce-ce378d063a58 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:43.450289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da4798-aa78-4059-9a03-836b47e5f286 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:43.487782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:43.488481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.488795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.489075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.490246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:43.491698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:43.493373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:43.500547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:43.504509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:43.510482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Jul 27 08:19:43 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:43.619876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb816c-e9cc-4170-8e61-884db1c44b0c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:43.657975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975ebd-d651-4cc1-9481-1980fc13a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:43.658533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975ebd-d651-4cc1-9481-1980fc13a926 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:43.658819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975ebd-d651-4cc1-9481-1980fc13a926 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:43.659216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975ebd-d651-4cc1-9481-1980fc13a926 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:43.659918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975ebd-d651-4cc1-9481-1980fc13a926 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:43.661420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975ebd-d651-4cc1-9481-1980fc13a926 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:43.742666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:19:43 2022] POST /identity/v3/projects => generated 312 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:45.345051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e14e89-0b53-4e40-8832-cfed78498dde None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.345603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e14e89-0b53-4e40-8832-cfed78498dde None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.345695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e14e89-0b53-4e40-8832-cfed78498dde None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.347003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:45.352186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.352598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.352776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.371522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:45.373728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:45.424417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:45.440987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:45.464186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e14e89-0b53-4e40-8832-cfed78498dde None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:45.567224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e14e89-0b53-4e40-8832-cfed78498dde None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:45.599424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d077f-72cc-4eb1-8b81-99fca0e950b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:45.599989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d077f-72cc-4eb1-8b81-99fca0e950b8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.600269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d077f-72cc-4eb1-8b81-99fca0e950b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.600543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d077f-72cc-4eb1-8b81-99fca0e950b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.611386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d077f-72cc-4eb1-8b81-99fca0e950b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e08d077f-72cc-4eb1-8b81-99fca0e950b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:45.616303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:45.617288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:19:45.618063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:45.623320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:45.721364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39501-4af8-4614-b217-ae447b2d1e5a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:45.744584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056895f-32ef-4f29-9bbf-949e5590b41a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.744906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056895f-32ef-4f29-9bbf-949e5590b41a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.745187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056895f-32ef-4f29-9bbf-949e5590b41a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.746545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 26/50] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:45.751375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.751728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.752013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.756015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:45.756641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.756961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.757244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.757976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:45.758465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:45.759850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:45.770717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:45.771917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:45.772329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 25/51] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:45.777839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:45.793364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:45.827649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:45.839410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 27/52] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:45.862963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:45.876152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f5e9b-e89c-43b7-98d4-2a0d855e61ac None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:45.910716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:45.911373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.911689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.911965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.913189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:45.914638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:45.916234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:45 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:45.922221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:45.959763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d478-ebbf-4cb1-9b02-17dcb50dad27 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:45.994481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:45.995458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:45.995764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:45.996042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:45.997667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:45.999130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:46.000746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 28/54] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:46.006176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:46.018188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa22a2-dcf1-4b4f-a6e3-a8bf75af6931 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:46.031561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:46.034577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:46.052410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:46.053169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:46.053461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:46.053747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:46.054904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:46.056336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:46.058013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:46.064717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:46.105976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b117c-0f17-4ec1-b196-a7cb0156f6a1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:46.140518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c694d3-4d81-4a6e-b128-49c60aed094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:46.141103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c694d3-4d81-4a6e-b128-49c60aed094f None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:46.141391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c694d3-4d81-4a6e-b128-49c60aed094f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:46.141673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c694d3-4d81-4a6e-b128-49c60aed094f None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:46.142357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c694d3-4d81-4a6e-b128-49c60aed094f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:46.143811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c694d3-4d81-4a6e-b128-49c60aed094f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:46.162016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaf1c7-ef7e-46ff-93b1-1f739cd2078a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:46.195177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:46.195796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:46.196082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:46.196359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:46.197189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.domain.id=default, user.id=7ba1e3f431c1414c8f4830c4c446296d) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:46.197500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:46.198928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04747451-6acf-49f0-91b6-1b027351e1b0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:46.206689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Jul 27 08:19:46 2022] GET /identity/v3/role_assignments?user.id=7ba1e3f431c1414c8f4830c4c446296d&scope.domain.id=default&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:46.229204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Jul 27 08:19:46 2022] POST /identity/v3/projects => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:19:48.227526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b13df-a7a7-4d59-bfe6-2fbc95849d36 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:48.228044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b13df-a7a7-4d59-bfe6-2fbc95849d36 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:48.228129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b13df-a7a7-4d59-bfe6-2fbc95849d36 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:48.229515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:48.234610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:48.234989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:48.235166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:48.252921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:48.254098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:48.317863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:48.342515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b13df-a7a7-4d59-bfe6-2fbc95849d36 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:48.391783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:48.442618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b13df-a7a7-4d59-bfe6-2fbc95849d36 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:48.475770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87af7d-efd3-443c-b5e9-5a6ad3f4f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:48.476404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87af7d-efd3-443c-b5e9-5a6ad3f4f105 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:48.476694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87af7d-efd3-443c-b5e9-5a6ad3f4f105 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:48.477006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87af7d-efd3-443c-b5e9-5a6ad3f4f105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:48.478207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87af7d-efd3-443c-b5e9-5a6ad3f4f105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:48.479614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87af7d-efd3-443c-b5e9-5a6ad3f4f105 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:48.481225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:48.486812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:48.494617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:48.584264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd3162-09b8-484f-a362-c10c4668d20a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:48.617521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020eee6-39cf-403b-8d79-60ef0dec9616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:48.618134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020eee6-39cf-403b-8d79-60ef0dec9616 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:48.618423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020eee6-39cf-403b-8d79-60ef0dec9616 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:48.618704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020eee6-39cf-403b-8d79-60ef0dec9616 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:48.619396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020eee6-39cf-403b-8d79-60ef0dec9616 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:48.620893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020eee6-39cf-403b-8d79-60ef0dec9616 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:48.712049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:19:48 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:51.787849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c33b00-792a-4eed-984c-e7ee0acd50c4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:51.788882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c33b00-792a-4eed-984c-e7ee0acd50c4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:51.789379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c33b00-792a-4eed-984c-e7ee0acd50c4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:51.791361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:51.796793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c2d8-499c-4ab3-be3e-1cf96d7cfbad None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:51.797617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c2d8-499c-4ab3-be3e-1cf96d7cfbad None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:51.798108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c2d8-499c-4ab3-be3e-1cf96d7cfbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:51.826404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d7e4c2d8-499c-4ab3-be3e-1cf96d7cfbad None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:51.827906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d7e4c2d8-499c-4ab3-be3e-1cf96d7cfbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:51.898742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:51.914827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:51.916332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e74c1-52a6-4f96-8b01-2da0962d5139 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:51.916967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e74c1-52a6-4f96-8b01-2da0962d5139 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:51.917432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e74c1-52a6-4f96-8b01-2da0962d5139 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:51.919517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 32/64] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:51.924855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0bfb1-046f-4caf-9ef2-d6859621b608 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:51.925154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0bfb1-046f-4caf-9ef2-d6859621b608 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:51.925439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0bfb1-046f-4caf-9ef2-d6859621b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:51.941235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e74c1-52a6-4f96-8b01-2da0962d5139 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:51.946896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1fc0bfb1-046f-4caf-9ef2-d6859621b608 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:51.947720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1fc0bfb1-046f-4caf-9ef2-d6859621b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:52.023546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 33/65] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:52.043346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d381b-c0a2-4caf-b9b1-f14be22053e8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.044434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d381b-c0a2-4caf-b9b1-f14be22053e8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.044934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d381b-c0a2-4caf-b9b1-f14be22053e8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.046456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 34/66] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:19:52.051524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.051978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.052399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.070609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:52.072014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:52.128088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e74c1-52a6-4f96-8b01-2da0962d5139 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.143282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 35/67] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:52.152757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.152931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.173393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.174058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.174336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.174620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.192867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:52.198031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:52.199064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 33/68] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:52.200032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.218884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.269147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0592d1f-02c1-4487-b420-16d5527f61fa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.305733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.306617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.307060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.307477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.308364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80937b6-18a4-49ad-b0b1-38c0f51d19c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.319319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:52.324572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:52.325520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:52.326352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:19:52.328671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 36/69] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:52.329727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.350201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.350854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.351139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.351495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.368672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:52.376163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:52.377050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:19:52.377791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:52.380772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 34/70] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:52.385760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.441472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.473730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5fae-2b0f-4061-98e9-f528391d041d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.491505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.511038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3490557-e392-44ea-9b43-836cbac8c3b9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.531073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.531977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.532416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.532862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.533786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:52.534251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:52.535998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:52.545937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 37/71] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:52.547070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.551566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.552196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.552480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.552782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.553506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:52.553810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:52.555198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33755f15-e728-43a0-9f1a-e3dc49ed49e3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:52.564478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 35/72] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:52.570177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a39f9-931d-4a92-a966-7a59aec25d24 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.570474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a39f9-931d-4a92-a966-7a59aec25d24 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.570762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a39f9-931d-4a92-a966-7a59aec25d24 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.572058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 36/73] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:52.573129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3652-741b-4cf2-9b79-979af351b3dd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.573588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3652-741b-4cf2-9b79-979af351b3dd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.574020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3652-741b-4cf2-9b79-979af351b3dd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.575962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 37/74] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:52.576871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3652-741b-4cf2-9b79-979af351b3dd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.668273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47196-6355-4a46-a8b1-889f75320f8b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.682699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.688370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3652-741b-4cf2-9b79-979af351b3dd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.707087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.708187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.708471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.708763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.709474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:52.709777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:52.711213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:52.720158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 38/75] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:52.721200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.729729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b0afa-0832-4c5c-8286-14215afaf22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.730449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b0afa-0832-4c5c-8286-14215afaf22d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.730801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b0afa-0832-4c5c-8286-14215afaf22d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.731134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b0afa-0832-4c5c-8286-14215afaf22d None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.749649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b0afa-0832-4c5c-8286-14215afaf22d None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:52.751128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b0afa-0832-4c5c-8286-14215afaf22d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:52.757229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:52.757229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580dbd-b2ec-4c0a-9fc1-53b25d47e4e1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.757229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580dbd-b2ec-4c0a-9fc1-53b25d47e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.757229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580dbd-b2ec-4c0a-9fc1-53b25d47e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.758027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.773842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-70580dbd-b2ec-4c0a-9fc1-53b25d47e4e1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:52.775055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-70580dbd-b2ec-4c0a-9fc1-53b25d47e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:52.824119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cb952-0dc3-400a-a673-482e912b7db2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.846463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:52.847759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.848051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.848333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.858194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:52.858836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:52.859119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:52.859392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:52.860549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:52.862030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:52.863755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:52.866586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.872718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:52.873928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:52.938863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 40/79] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:52.939712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:52.967845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec788b-4b52-4b2e-b66f-1abffdd1bd18 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:52.968906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:52.970456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.000582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.001354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.001640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.001915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.003083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.004529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.006171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 40/80] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:53.006939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.054588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14277b7c-2865-4865-9fe7-bcc884127e94 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.088215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.088787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.089074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.089348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.110890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f467868-bb16-402d-85b6-20d6f464094f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.145160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.145788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.146076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.146352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.155701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.157213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.174229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.187249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.213909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.215390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.252913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 41/81] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:19:53.253765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.315953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 41/82] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:19:53.316834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.359230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aa83c-98bd-478d-8367-889a7339185e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.375027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.383700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.392665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.393423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.393712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.393991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.404930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:53.409852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:53.410743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:53.416831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.417505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5240828-53c2-4448-b4a6-d9060cce1c1e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.446921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.447554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.447835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.448108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.449456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.451715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.453787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:53.454716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.520703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d569e-200a-41e2-81f2-701a2c8d3a2f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.555611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.555826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f405942-d3c0-46cd-9eff-249c45a742b3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.556229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.556516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.556829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.589938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.591342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.591661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.591940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.593167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.594624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.596403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 43/85] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:53.597209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.607223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.609027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.629614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.631036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.696813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fd8b2-1e8f-4ec0-9776-f9bf0d2292fd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.729975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.730204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 43/86] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:19:53.730617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.730904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.731790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.731889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.733161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.734618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.736281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:53.737051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.810353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.813335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:53.832568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81455b3-15ed-4812-98af-79ed61e9dee1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.834676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55442-0776-4514-9f60-25a9daa74986 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:53.867928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.868552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.868871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.868965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:53.869153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.869563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:53.869845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:53.869930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:53.870118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:53.870201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.870798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:53.871559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.872250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:53.880170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 44/88] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:53.881015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.946263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 45/89] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:19:53 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:53.947203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:53.998489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c537121-19ec-473a-a053-3b1c72a7b109 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.037933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:54.038755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:54.039045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:54.039324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:54.040291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=0d3280fb30b44a0285cf3806c6ddee79) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:54.040608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:54.042412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:54.056783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 45/90] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/role_assignments?user.id=0d3280fb30b44a0285cf3806c6ddee79&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:54.056783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:54.060040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:54.074217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f48d8-0d3e-4760-9d5d-e52978b5ccda None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.123629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:54.128227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:54.128965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:54.129257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:54.129537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:54.141190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:54.141190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:54.141190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 46/91] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:53 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:54.141190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:54.209012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07920-d0f2-47bd-a4d6-4b8102c5c8e6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.260651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:54.261336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:54.261626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:54.261907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:54.263250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=7ba1e3f431c1414c8f4830c4c446296d) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:54.263675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:54.266370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:54.273845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 46/92] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:19:54 2022] GET /identity/v3/role_assignments?user.id=7ba1e3f431c1414c8f4830c4c446296d&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:54.274677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:54.277020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf96db-1c30-4e64-a136-8bfa63e6236d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.322377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:54.323537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:54.324394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:54.325468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:54.327299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:54.329669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:54.332055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 47/93] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:54 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:54.342197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:54.376076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:54.443662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fc545-3750-487d-aa77-3753a1b03b9b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.503705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:54.521220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:54.521861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:54.522146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:54.522420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:54.523223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] RBAC: Adding query filter params (role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=0d3280fb30b44a0285cf3806c6ddee79) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:54.523533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:54.525001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:54.536926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:19:54 2022] GET /identity/v3/role_assignments?user.id=0d3280fb30b44a0285cf3806c6ddee79&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:54.567065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d2d9f-8d88-4a85-a1e1-7a4487928bc7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.618885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:54.619544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:54.619831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:54.620109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:54.722491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:54.722491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:54.797818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:54.843243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 48/95] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:19:54.848451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:54.966385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169740e-92cf-4fb2-bd9c-f9654fc5e536 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:54.996994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:55.002983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef168913-591e-4dfa-ba62-37645d759d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:55.003636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef168913-591e-4dfa-ba62-37645d759d2c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:55.003925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef168913-591e-4dfa-ba62-37645d759d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:55.004369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef168913-591e-4dfa-ba62-37645d759d2c None admin] PATH_INFO: `/v3/projects/3114ff75599d4e12aa32dfe5e2442638` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:55.005701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef168913-591e-4dfa-ba62-37645d759d2c None admin] RBAC: Authorizing `identity:get_project(project_id=3114ff75599d4e12aa32dfe5e2442638)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:55.013190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef168913-591e-4dfa-ba62-37645d759d2c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:55.013190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:54 2022] GET /identity/v3/projects/3114ff75599d4e12aa32dfe5e2442638 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:55.015666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:55.126432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3a60-9987-4dd1-8020-fa7e659e206f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:55.173672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:55.174299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:55.174638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:55.174916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:55.175766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=3114ff75599d4e12aa32dfe5e2442638, user.id=0d3280fb30b44a0285cf3806c6ddee79) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:55.176076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:55.177622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e6c6a-16bd-46d0-82bb-30890c69f916 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:55.189225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:19:55 2022] GET /identity/v3/role_assignments?user.id=0d3280fb30b44a0285cf3806c6ddee79&scope.project.id=3114ff75599d4e12aa32dfe5e2442638&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:56.838622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3238-1ef2-4e66-b516-e31072fc0774 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:56.839558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3238-1ef2-4e66-b516-e31072fc0774 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:56.840068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3238-1ef2-4e66-b516-e31072fc0774 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:56.843292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:56.859135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:56.860030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:56.860503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:56.866822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1041-b220-42ef-8798-4aef891a15b0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:56.867133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1041-b220-42ef-8798-4aef891a15b0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:56.867399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1041-b220-42ef-8798-4aef891a15b0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:56.868792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 50/99] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:19:56.878378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:56.878675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:56.878964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:56.882307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:56.883705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:56.910798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:56.912018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:56.917089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:57.013119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 50/100] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:57.054417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:57.057865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.123192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.248999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791cd13-26a2-4ffa-a451-b77ba5b389dd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:57.296142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ccfb4-8619-4a9c-a273-74cda2cb9cd7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:57.326693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:57.327369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.327656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.327931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.343443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:57.356750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:57.357499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:57.358411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:19:57.359147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 51/102] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:57.369461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d797c-e626-4115-b1cc-d4f462735d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:57.369687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.370500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d797c-e626-4115-b1cc-d4f462735d9e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.377040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d797c-e626-4115-b1cc-d4f462735d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.377040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d797c-e626-4115-b1cc-d4f462735d9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.391166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d797c-e626-4115-b1cc-d4f462735d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-276d797c-e626-4115-b1cc-d4f462735d9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:57.396298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:57.397246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:57.398493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 52/103] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:57.399358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be2fb3-9105-4a42-8cb1-733611f0271f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.399446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be2fb3-9105-4a42-8cb1-733611f0271f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.400565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be2fb3-9105-4a42-8cb1-733611f0271f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.401385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 53/104] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:57.407114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.407406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.407688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.413064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:57.426030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:57.427258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:57.498474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 54/105] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:19:57.499397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.506206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bda79-4402-48ab-9618-5ae968845dbf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:57.548155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:57.548804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.549251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.549670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.550527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:57.550977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:57.552523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3810-04f1-45ad-b0df-9cf68727e5a8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:57.561752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 52/106] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:57.563145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1efd-4410-47a1-a259-5b98eb6aaeed None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.563580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1efd-4410-47a1-a259-5b98eb6aaeed None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.563985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1efd-4410-47a1-a259-5b98eb6aaeed None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.565382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 53/107] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:57.566230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f1efd-4410-47a1-a259-5b98eb6aaeed None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.650763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb80cd5-b73a-438d-84a8-02d38cf3ac2f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:57.671564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:57.676117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:57.701302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f1efd-4410-47a1-a259-5b98eb6aaeed None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:57.707810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:57.709092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.709740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.710387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.711771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:57.712465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:57.715092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:57.733152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 55/108] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:57.735135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.755925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64000fbc-7c13-43e0-a904-b48d602b0049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:57.756714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000fbc-7c13-43e0-a904-b48d602b0049 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.757096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000fbc-7c13-43e0-a904-b48d602b0049 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.757482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64000fbc-7c13-43e0-a904-b48d602b0049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.768349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64000fbc-7c13-43e0-a904-b48d602b0049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-64000fbc-7c13-43e0-a904-b48d602b0049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:57.774661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:57.775556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:19:57.776306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 54/109] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:57.784968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:57.784968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:57.784968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:57.859068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:57.861006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:57.946690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 55/110] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:57.950141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:57.966410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e314a-2c8c-40c0-a2f7-804bcfdbf9e5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.000147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.000744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.001044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.001330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] PATH_INFO: `/v3/users/c9f0ecbf5d9f4d539e66622093e5447b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.015644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] RBAC: Authorizing `identity:get_user(user_id=c9f0ecbf5d9f4d539e66622093e5447b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.017152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.018913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 56/111] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/users/c9f0ecbf5d9f4d539e66622093e5447b => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.019687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.036605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.062511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0554ab5-aff2-4bfd-b92e-c869474bb579 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.064916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.099395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068ffba-809d-421e-b002-113c9ff1f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.100079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068ffba-809d-421e-b002-113c9ff1f25e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.100379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068ffba-809d-421e-b002-113c9ff1f25e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.100648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068ffba-809d-421e-b002-113c9ff1f25e None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.101859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068ffba-809d-421e-b002-113c9ff1f25e None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.103308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068ffba-809d-421e-b002-113c9ff1f25e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.104942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 56/112] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:57 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.106419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d697e-a5c7-4d1b-8c5f-39d599a132e2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.106716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d697e-a5c7-4d1b-8c5f-39d599a132e2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.106995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d697e-a5c7-4d1b-8c5f-39d599a132e2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.108347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 57/113] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:58.113284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d697e-a5c7-4d1b-8c5f-39d599a132e2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.125369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4b81d-9b76-443c-86f0-2e2556d2d736 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.160371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.161009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.161295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.161573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.162286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:58.162592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.163964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.172229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 57/114] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.173124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.212694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d697e-a5c7-4d1b-8c5f-39d599a132e2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.246015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948af36-f955-4518-8079-a20254ce1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.247499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948af36-f955-4518-8079-a20254ce1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.247790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948af36-f955-4518-8079-a20254ce1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.248056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948af36-f955-4518-8079-a20254ce1fe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.249240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948af36-f955-4518-8079-a20254ce1fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.250692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948af36-f955-4518-8079-a20254ce1fe5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.252297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 58/115] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.253536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ac96-233f-4ac2-95d4-4d58fd1ead3d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.253830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ac96-233f-4ac2-95d4-4d58fd1ead3d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.254107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ac96-233f-4ac2-95d4-4d58fd1ead3d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.255487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 59/116] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:19:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:19:58.256089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ac96-233f-4ac2-95d4-4d58fd1ead3d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.268158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.278356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.281336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04863-2cfe-41a9-8eca-fc3b9c77452e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.315492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.316114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.316484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.316793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.356720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ac96-233f-4ac2-95d4-4d58fd1ead3d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.383569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.385066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.390134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f4d4f-a0e9-4f37-aacb-302a736efcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.390776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4d4f-a0e9-4f37-aacb-302a736efcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.391062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4d4f-a0e9-4f37-aacb-302a736efcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.391343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4d4f-a0e9-4f37-aacb-302a736efcb9 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.392502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f4d4f-a0e9-4f37-aacb-302a736efcb9 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.394056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f4d4f-a0e9-4f37-aacb-302a736efcb9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.395741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 60/117] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.396877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.397164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.397440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.414842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:58.416028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:58.479416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.482386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 61/118] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:58.483223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.488375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 58/119] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:19:58.488375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.502982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.589325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e311e2-cb69-4e86-96eb-573b2be11068 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.591128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970f566-dc4a-423c-9c8a-9b0d81e928dc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.623550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.624163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.624447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.624721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.625227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa12e2-c497-4855-884e-264b1dac79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.625433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.625871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa12e2-c497-4855-884e-264b1dac79a5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.626161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa12e2-c497-4855-884e-264b1dac79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.626438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa12e2-c497-4855-884e-264b1dac79a5 None admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.626869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.627627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa12e2-c497-4855-884e-264b1dac79a5 None admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.629108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa12e2-c497-4855-884e-264b1dac79a5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.630923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 62/120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.631821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.632112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.632387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.649922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:19:58.651123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:19:58.715110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 63/121] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:19:58.716619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.724043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.736772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 59/122] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:19:58 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:19:58.737778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.811181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:58.832963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5abf0-4e89-484e-8211-640ddf0256ff None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.866672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c0ccc-e5a4-46b0-8e9e-7c577f9b0fa6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:58.874790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.875492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.875771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.876051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857/users/0d3280fb30b44a0285cf3806c6ddee79/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.878339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] RBAC: Authorizing `identity:create_grant(project_id=b64bc241f35f424c9a76859c67138857, user_id=0d3280fb30b44a0285cf3806c6ddee79, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.879823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.906249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:58.906962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:58.907250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:58.907530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:58.908701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:58.910188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:58.911922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 60/123] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:58.912691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:58.992836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 64/124] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:19:58 2022] PUT /identity/v3/projects/b64bc241f35f424c9a76859c67138857/users/0d3280fb30b44a0285cf3806c6ddee79/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:19:58.992836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.024083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaa8d6-3e5c-4286-8708-e10e3fd5560c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.053915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:59.070846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:59.077990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.078791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.079082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.079362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.095574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:59.102859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:59.103759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:19:59.104497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:59.105391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 61/125] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:59.106240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.117894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dac54-d376-4ca1-a92b-86d7768f6183 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.162586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.163353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.163708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.164060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.165701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:59.167136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:59.170294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 65/126] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:58 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:59.171036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.255653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7d61-133a-453a-9f95-e322fdfca444 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.291944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.293022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.293600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.294278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.303559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe19ca-40d4-4bae-889d-c98eae2d2e70 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.305761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:19:59.312695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:19:59.313655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:19:59.314419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:19:59.316873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 62/127] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:19:59.318000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.350453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.351551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.352040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.352555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.353919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] RBAC: Adding query filter params (role.id=f89a78d60628474da50e2eae723e655b, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=c9f0ecbf5d9f4d539e66622093e5447b) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:59.354562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:59.356528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:59.359125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:59.363803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 66/128] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/role_assignments?user.id=c9f0ecbf5d9f4d539e66622093e5447b&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=f89a78d60628474da50e2eae723e655b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:59.370713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.373920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:59.508112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55305e22-95ee-494f-9c40-e02bbbe97086 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.562359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc3925-5416-4adc-866a-01189ceb7542 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.585920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.586545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.586836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.587171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.587840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:59.588151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:59.589577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:59.602420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.603430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.603912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.604403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857/users/7ba1e3f431c1414c8f4830c4c446296d/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.606247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 63/129] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:59.606939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.607679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b64bc241f35f424c9a76859c67138857, user_id=7ba1e3f431c1414c8f4830c4c446296d, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:59.609541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:59.717137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fbe43-1e19-47fa-ac8f-9a6552cc26af None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.718659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:59.752281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.752949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.753237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.753518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.754240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:19:59.754557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:59.755444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 67/130] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:19:59 2022] PUT /identity/v3/projects/b64bc241f35f424c9a76859c67138857/users/7ba1e3f431c1414c8f4830c4c446296d/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:19:59.760256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:59.761689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.765927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 64/131] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:19:59.776783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:19:59.914866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:19:59.936998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73086-81ba-42e9-8704-94df7a287d38 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:19:59.975100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:19:59.975755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:19:59.976043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:19:59.976321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:19:59.977525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:19:59.978977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:19:59.980579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 65/132] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:19:59.987115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:00.022608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:00.031692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b901-86bd-481c-a64d-d44cf5b86e6b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:00.098005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cba7b-7fc3-4490-b2af-a87b744b0111 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:00.125977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:00.126647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:00.126943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:00.127229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:00.133479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:00.134309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:00.134943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:00.135051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:00.135236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:00.135517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] PATH_INFO: `/v3/projects/3114ff75599d4e12aa32dfe5e2442638` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:00.136592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 68/133] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:00.136688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] RBAC: Authorizing `identity:get_project(project_id=3114ff75599d4e12aa32dfe5e2442638)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:00.138423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:00.140401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 66/134] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:19:59 2022] GET /identity/v3/projects/3114ff75599d4e12aa32dfe5e2442638 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:00.145994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:00.146124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:00.306530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0e20-b54c-4647-bb2f-24dac72b37c6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:00.336663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:00.342418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:00.345814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec40e-4739-4488-bfe9-13e5e0f4323c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:00.348525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:00.349434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:00.349846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:00.352570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:00.352803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:00.354407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:00.356533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 69/135] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:00 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:00.362316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:00.433370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c74c-5d12-48f6-9490-4856b6001403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:00.434933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c74c-5d12-48f6-9490-4856b6001403 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:00.435459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c74c-5d12-48f6-9490-4856b6001403 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:00.435808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c74c-5d12-48f6-9490-4856b6001403 None admin] PATH_INFO: `/v3/projects/3114ff75599d4e12aa32dfe5e2442638/users/0d3280fb30b44a0285cf3806c6ddee79/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:00.438330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008c74c-5d12-48f6-9490-4856b6001403 None admin] RBAC: Authorizing `identity:create_grant(project_id=3114ff75599d4e12aa32dfe5e2442638, user_id=0d3280fb30b44a0285cf3806c6ddee79, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:00.439770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008c74c-5d12-48f6-9490-4856b6001403 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:00.493347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6ab2-8a6b-499e-baea-c3eb771378b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:00.530798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927c9b0-afd5-4823-a665-cb37cb0b3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:00.531534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927c9b0-afd5-4823-a665-cb37cb0b3d62 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:00.531822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927c9b0-afd5-4823-a665-cb37cb0b3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:00.532100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927c9b0-afd5-4823-a665-cb37cb0b3d62 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857/users/0d3280fb30b44a0285cf3806c6ddee79/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:00.534479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927c9b0-afd5-4823-a665-cb37cb0b3d62 None admin] RBAC: Authorizing `identity:create_grant(project_id=b64bc241f35f424c9a76859c67138857, user_id=0d3280fb30b44a0285cf3806c6ddee79, role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:00.535939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927c9b0-afd5-4823-a665-cb37cb0b3d62 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:00.541446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 67/136] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:00 2022] PUT /identity/v3/projects/3114ff75599d4e12aa32dfe5e2442638/users/0d3280fb30b44a0285cf3806c6ddee79/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:00.611458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 70/137] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:00 2022] PUT /identity/v3/projects/b64bc241f35f424c9a76859c67138857/users/0d3280fb30b44a0285cf3806c6ddee79/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:20:01.052873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba9219-18ec-4bde-a2c8-cd607f4e1723 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:01.053245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba9219-18ec-4bde-a2c8-cd607f4e1723 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:01.053445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba9219-18ec-4bde-a2c8-cd607f4e1723 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:01.055108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 68/138] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:01.061165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:01.061609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:01.061781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:01.085010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:01.086203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:01.162342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:01.184962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 71/139] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:01.210601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba9219-18ec-4bde-a2c8-cd607f4e1723 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:01.322518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba9219-18ec-4bde-a2c8-cd607f4e1723 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:01.358941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c6c0-fe0e-4484-8cd9-4471f85a5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:01.359595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c6c0-fe0e-4484-8cd9-4471f85a5922 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:01.359885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c6c0-fe0e-4484-8cd9-4471f85a5922 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:01.360164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c6c0-fe0e-4484-8cd9-4471f85a5922 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:01.361347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c6c0-fe0e-4484-8cd9-4471f85a5922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:01.362857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c6c0-fe0e-4484-8cd9-4471f85a5922 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:01.368899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 69/140] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:01.370440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:01.507665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf324-9f49-4d68-8b8b-aeb0e12c376b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:01.552230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba7fbd-e924-4bc6-b84c-fc64b241d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:01.552891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba7fbd-e924-4bc6-b84c-fc64b241d7f1 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:01.553177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba7fbd-e924-4bc6-b84c-fc64b241d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:01.553450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba7fbd-e924-4bc6-b84c-fc64b241d7f1 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:01.554153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba7fbd-e924-4bc6-b84c-fc64b241d7f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:01.555600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba7fbd-e924-4bc6-b84c-fc64b241d7f1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:01.685433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 72/141] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:01 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:01.814464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86774f7-75cd-4712-b583-72325d291642 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:01.814781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86774f7-75cd-4712-b583-72325d291642 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:01.815038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86774f7-75cd-4712-b583-72325d291642 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:01.816529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 70/142] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:01.822103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:01.822664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:01.823185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:01.849848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:01.851374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:01.901745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:01.946249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 73/143] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:02.006181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86774f7-75cd-4712-b583-72325d291642 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:02.038297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:02.124180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86774f7-75cd-4712-b583-72325d291642 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:02.160652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:02.161364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:02.161654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:02.161934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:02.173091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:02.178094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:02.178925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:02.179678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:02.184622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 71/144] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:02.189858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:02.316352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca87a4-c3de-4fae-bee5-ec30609dd5db None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:02.355346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:02.356101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:02.356433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:02.356711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:02.357456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:02.357760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:02.359145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:02.367537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 74/145] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:02.373769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:02.480991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:02.499112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e277-ad43-459d-a3b9-d249b22e1f52 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:02.553204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2945b-1340-48a7-b1b2-27ab17811001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:02.553853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2945b-1340-48a7-b1b2-27ab17811001 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:02.554140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2945b-1340-48a7-b1b2-27ab17811001 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:02.554421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2945b-1340-48a7-b1b2-27ab17811001 None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:02.561536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2945b-1340-48a7-b1b2-27ab17811001 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:02.563029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2945b-1340-48a7-b1b2-27ab17811001 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:02.564699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 72/146] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:02 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:02.570246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:02.607041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:02.669704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c628b74-3729-45b5-a77b-4af5c710d8f3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:02.670042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c628b74-3729-45b5-a77b-4af5c710d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:02.670260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c628b74-3729-45b5-a77b-4af5c710d8f3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:02.671794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 73/147] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:02.686360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:02.686639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:02.686912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:02.714771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8d8e3-bec5-4377-bbb7-2fbf7b20bc40 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:02.717309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:02.718550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:02.783289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:02.784177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:02.784460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:02.784758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:02.875107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 74/148] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:02.892603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:02.894182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:02.909223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:02.955344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:03.052461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:03.081141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835de99-8aca-4e9f-88bb-22968ff16185 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:03.088315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 75/149] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:03.092644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:03.156560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:03.157682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.158171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.158641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.175766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:03.181238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:03.182064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:03.182807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:03.185349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 75/150] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:03.191934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:03.301214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53158a39-bfdf-42a1-9f31-24ad78c2dadf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:03.327459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ba01c-7d92-4d19-855b-4e101567c177 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:03.344943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:03.361447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:03.362123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.362405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.362680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.368375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:03.368375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:03.368375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 76/151] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:03 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:03.374440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:03.376658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063760-6046-4530-b9be-218680687944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:03.377965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063760-6046-4530-b9be-218680687944 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.378452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063760-6046-4530-b9be-218680687944 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.378924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063760-6046-4530-b9be-218680687944 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.379916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea063760-6046-4530-b9be-218680687944 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:03.380435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea063760-6046-4530-b9be-218680687944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:03.382041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea063760-6046-4530-b9be-218680687944 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:03.395622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:03.401338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063760-6046-4530-b9be-218680687944 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:03.419972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:03.521430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7cfc-943d-4c2a-9cd3-ea78a7d67f82 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:03.521763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063760-6046-4530-b9be-218680687944 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:03.556697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe40a-1952-40d2-9b28-3d694c58606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:03.557375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe40a-1952-40d2-9b28-3d694c58606a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.557659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe40a-1952-40d2-9b28-3d694c58606a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.557936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe40a-1952-40d2-9b28-3d694c58606a None admin] PATH_INFO: `/v3/users/c9f0ecbf5d9f4d539e66622093e5447b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.559639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe40a-1952-40d2-9b28-3d694c58606a None admin] RBAC: Authorizing `identity:get_user(user_id=c9f0ecbf5d9f4d539e66622093e5447b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:03.561112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe40a-1952-40d2-9b28-3d694c58606a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:03.562840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 77/153] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:03 2022] GET /identity/v3/users/c9f0ecbf5d9f4d539e66622093e5447b => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:03.564129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345b45-d375-4fb8-b263-02d9a5d9bdf3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.564420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345b45-d375-4fb8-b263-02d9a5d9bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.564695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345b45-d375-4fb8-b263-02d9a5d9bdf3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.565938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 78/154] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:03.567081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408bb63-a210-4052-988e-dac9ef695bbe None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.567641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408bb63-a210-4052-988e-dac9ef695bbe None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.567837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408bb63-a210-4052-988e-dac9ef695bbe None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.569212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 79/155] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:03.572860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5018bb8-f9e8-4284-9d59-c4b0d0cfacb7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.575072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5018bb8-f9e8-4284-9d59-c4b0d0cfacb7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.575340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5018bb8-f9e8-4284-9d59-c4b0d0cfacb7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.576695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 80/156] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:03.577442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5018bb8-f9e8-4284-9d59-c4b0d0cfacb7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:03.613479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:03.614126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.614415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.614694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.615502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=0d3280fb30b44a0285cf3806c6ddee79) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:03.615815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:03.617552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c05a5-88b5-4097-ac33-df31f4b3937d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:03.639530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 77/157] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:03 2022] GET /identity/v3/role_assignments?user.id=0d3280fb30b44a0285cf3806c6ddee79&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:03.641097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4743-6dac-4d3b-984a-e755d773750c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.641393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4743-6dac-4d3b-984a-e755d773750c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.641674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4743-6dac-4d3b-984a-e755d773750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.677896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b40a4743-6dac-4d3b-984a-e755d773750c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:03.679049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b40a4743-6dac-4d3b-984a-e755d773750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:03.681478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:03.692563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5018bb8-f9e8-4284-9d59-c4b0d0cfacb7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:03.734899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48201477-81ea-4898-a3fb-ecde963b4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:03.735837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201477-81ea-4898-a3fb-ecde963b4898 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.736208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201477-81ea-4898-a3fb-ecde963b4898 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.736555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201477-81ea-4898-a3fb-ecde963b4898 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.737933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48201477-81ea-4898-a3fb-ecde963b4898 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:03.740273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48201477-81ea-4898-a3fb-ecde963b4898 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:03.742133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 81/158] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:03 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:03.743603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.744030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.744450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.766921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:03.768401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:03.826282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:03.846460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 78/159] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:03.847810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:03.848105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:03.848452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:03.850172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 82/160] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:03.853992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:03.890161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:03.891393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:03.970414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.002145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 79/161] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:04.003015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.003745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050ad02-ee22-4c34-a89f-15850c74079e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.050380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.051068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.052850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.053493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857/users/c9f0ecbf5d9f4d539e66622093e5447b/roles/f89a78d60628474da50e2eae723e655b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.055905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b64bc241f35f424c9a76859c67138857, user_id=c9f0ecbf5d9f4d539e66622093e5447b, role_id=f89a78d60628474da50e2eae723e655b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:04.057857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:04.126621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cd3a5-5b92-40ae-bcb9-36baa52038c2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.140966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 83/162] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:03 2022] PUT /identity/v3/projects/b64bc241f35f424c9a76859c67138857/users/c9f0ecbf5d9f4d539e66622093e5447b/roles/f89a78d60628474da50e2eae723e655b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:04.142166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.162473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.169274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.170435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.170925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.171424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.183271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:04.189468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:04.190466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:04.191241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:04.193295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 80/163] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:04.194937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.303363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9bf5-0a6c-44ed-9694-37610b4b04bd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.360931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.361744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.362153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.362534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.364339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ae13f-f4cd-4fb9-b553-be1ac48dccc3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.365077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.380036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:04.385492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:04.386413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:04.387296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 84/164] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:04.387945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.426344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.427233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.427648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.428080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.448184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:04.454113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:04.455276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:04.456042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:04.458593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 81/165] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:04.459755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.507033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d0ee-064f-4a8d-85e9-647037a77954 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.543296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.546488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.547349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.547849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.548302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.549231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:04.549719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:04.551256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:04.561031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 85/166] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:04.562357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.625707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.654081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8051-de61-45b1-ad34-de9916e80f8e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.683744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6fdc-2d5c-4b93-aadb-b19e91fcca3c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.725535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.726160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.726438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.726767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.727486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:04.729101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:04.730641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:04.748477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 82/167] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:04.754079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.756048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.756682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.756996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.757272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.758000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:04.758312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:04.760140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:04.780569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 86/168] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:04.782558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:04.918165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ba51-7105-4124-95ce-bc01ac61d46c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.937217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9211-7dd4-4d21-9d8b-b55104d75e45 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:04.943045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.944557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:04.947958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:04.948941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:04.949970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:04.950394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] PATH_INFO: `/v3/users/7ba1e3f431c1414c8f4830c4c446296d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:04.951721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] RBAC: Authorizing `identity:get_user(user_id=7ba1e3f431c1414c8f4830c4c446296d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:04.955502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:04.960718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 87/169] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/users/7ba1e3f431c1414c8f4830c4c446296d => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:04.960718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:05.005629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:05.006641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:05.007071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:05.007493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:05.009266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:05.012743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:05.016654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 83/170] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:05.019851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:05.158432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da962-01e1-4d8a-b38c-992cdf9b373e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:05.186403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e359f7-3617-44c4-93e6-ce4dc028e6e3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:05.216140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:05.216825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:05.217114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:05.217395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] PATH_INFO: `/v3/users/0d3280fb30b44a0285cf3806c6ddee79` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:05.221551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] RBAC: Authorizing `identity:get_user(user_id=0d3280fb30b44a0285cf3806c6ddee79)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:05.223309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:05.229454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 88/171] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:04 2022] GET /identity/v3/users/0d3280fb30b44a0285cf3806c6ddee79 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:05.229454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:05.243518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:05.244411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:05.248225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:05.248684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:05.305757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:05.324289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:05.355437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad035986-0bf3-406f-b734-451b5db476aa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:05.378900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:05.380708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:05.393588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:05.394831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:05.395289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:05.395744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:05.473089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:05.474787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:05.533114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:05.583557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 89/172] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:05.584776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:05.627357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 84/173] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:05.628235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:05.697934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b52200-5895-4157-ad8d-c9d98e498357 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:05.735714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:05.736720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:05.737172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:05.738012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:05.765697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:05.814204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:05.816125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:05.885519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:05.930397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 90/174] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:05.931347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.002788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f44870-69c8-4026-8255-43564d241db3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.003424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:06.051249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce59b-6787-43ac-8bb9-8f6ef9622d3e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.094823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1483f-bc41-470a-bb11-f861faf14e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.095830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1483f-bc41-470a-bb11-f861faf14e95 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.096322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1483f-bc41-470a-bb11-f861faf14e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.096832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1483f-bc41-470a-bb11-f861faf14e95 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.098410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1483f-bc41-470a-bb11-f861faf14e95 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:06.100067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1483f-bc41-470a-bb11-f861faf14e95 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:06.107540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 85/175] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:05 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:06.108805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ecd7f-58fa-4302-b71b-9af11a4483de None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.109097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ecd7f-58fa-4302-b71b-9af11a4483de None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.109376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ecd7f-58fa-4302-b71b-9af11a4483de None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.110609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 86/176] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:06.111380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ecd7f-58fa-4302-b71b-9af11a4483de None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.126416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.127448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.128429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.128935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.132862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:06.134686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:06.140649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 91/177] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:05 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:06.141871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.263385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be18d1-a1f4-43c5-9678-954a61bb12e0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.270397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ecd7f-58fa-4302-b71b-9af11a4483de None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.287992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:06.300044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.304849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.304849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.304849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.304849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] RBAC: Adding query filter params (role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=0d3280fb30b44a0285cf3806c6ddee79) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:06.304849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:06.304849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500a6a7-c4f3-4113-b5fd-0094ac689c58 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:06.310241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 92/178] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/role_assignments?user.id=0d3280fb30b44a0285cf3806c6ddee79&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:06.311954 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254648-ba40-4727-9252-cd8531355ab2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.312390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254648-ba40-4727-9252-cd8531355ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.312769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254648-ba40-4727-9252-cd8531355ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.314970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.315856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.316308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.316806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] PATH_INFO: `/v3/projects/3114ff75599d4e12aa32dfe5e2442638` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.318252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] RBAC: Authorizing `identity:get_project(project_id=3114ff75599d4e12aa32dfe5e2442638)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:06.319946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:06.323252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 87/179] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/projects/3114ff75599d4e12aa32dfe5e2442638 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:06.325133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.335474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-76254648-ba40-4727-9252-cd8531355ab2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:06.336932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-76254648-ba40-4727-9252-cd8531355ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:06.339208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:06.417720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 93/180] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:06.419304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687450c-392b-4e13-bff8-c9aac7c4dd36 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.420034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687450c-392b-4e13-bff8-c9aac7c4dd36 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.420034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687450c-392b-4e13-bff8-c9aac7c4dd36 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.421336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 94/181] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:06.425488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687450c-392b-4e13-bff8-c9aac7c4dd36 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.467711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fc2b7-b35c-4fc6-a5d9-31d10c09490d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.531485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.532495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.533017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.533501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.535116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=7ba1e3f431c1414c8f4830c4c446296d) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:06.535905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:06.538339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54b90-4791-4a5c-99c3-5b5efa6a55ff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:06.547723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 88/182] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/role_assignments?user.id=7ba1e3f431c1414c8f4830c4c446296d&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:06.549152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687450c-392b-4e13-bff8-c9aac7c4dd36 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.549499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9468d-3363-49ee-a554-cec43f6fa733 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.549949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9468d-3363-49ee-a554-cec43f6fa733 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.550410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9468d-3363-49ee-a554-cec43f6fa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.575739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:06.580387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-73d9468d-3363-49ee-a554-cec43f6fa733 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:06.582652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-73d9468d-3363-49ee-a554-cec43f6fa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:06.601424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.602171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.603297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.603598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.604896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=3114ff75599d4e12aa32dfe5e2442638, user.id=0d3280fb30b44a0285cf3806c6ddee79) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:06.604896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:06.607458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:06.616589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 95/183] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/role_assignments?user.id=0d3280fb30b44a0285cf3806c6ddee79&scope.project.id=3114ff75599d4e12aa32dfe5e2442638&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:06.617792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.682693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 89/184] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:06.685050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d8ef-a2c0-4ce4-a152-6e030daf4a95 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.685563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d8ef-a2c0-4ce4-a152-6e030daf4a95 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.686501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d8ef-a2c0-4ce4-a152-6e030daf4a95 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.688105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 90/185] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:06.694235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.694790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.695271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.706083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:06.721515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:06.723722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:06.815558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 91/186] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:06.817526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.823489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376577ad-3ce9-46c8-985e-977bcaee4314 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.867229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:06.867882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:06.868166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:06.868444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:06.883261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:06.890177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:06.891100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:06.891892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 96/187] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:06.892563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:06.957700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b7345-31d5-413f-b372-9f7013b9506c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:06.960678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.006833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.007523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.008343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.008659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.010408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.012485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.014298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 92/188] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:07.017829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.021529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.037433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116d48-060d-4288-ae18-6594a2f633d8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.080386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.081010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.081293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.081568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.092750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:07.098157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:07.099014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:07.099794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 97/189] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:07.100449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.139893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b32484-9b4f-4ff7-89c6-aecbe58abd69 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.174332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.174993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.175281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.175553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.176421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:07.176615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.177965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.187268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 93/190] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:07.188188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.210393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.213464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068cf29-5f40-478d-b4df-88ea6e7fd807 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.248669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a8de-e9e3-4c92-87fc-3e6a60ef9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.249317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a8de-e9e3-4c92-87fc-3e6a60ef9a6c None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.249604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a8de-e9e3-4c92-87fc-3e6a60ef9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.249880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a8de-e9e3-4c92-87fc-3e6a60ef9a6c None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.250559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74a8de-e9e3-4c92-87fc-3e6a60ef9a6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.251985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74a8de-e9e3-4c92-87fc-3e6a60ef9a6c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.254501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.294112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e44e2-0a42-422c-96b1-00ca006e6ae7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.327249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.327868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.328152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.328428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.329169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:07.329476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.330901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.338547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 94/191] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:07.339378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.372411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 98/192] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:07 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:07.372411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b5e8-1d58-474d-be07-c06fbb23ed53 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.372411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b5e8-1d58-474d-be07-c06fbb23ed53 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.372411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b5e8-1d58-474d-be07-c06fbb23ed53 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.372411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 99/193] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:07.372411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4b5e8-1d58-474d-be07-c06fbb23ed53 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.445417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281436fe-acb2-4d93-a7a6-fdbcedd91f03 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.474134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.484259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb403-1a72-46fe-9f83-93f3f85040d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.487933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb403-1a72-46fe-9f83-93f3f85040d2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.487933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb403-1a72-46fe-9f83-93f3f85040d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.487933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb403-1a72-46fe-9f83-93f3f85040d2 None admin] PATH_INFO: `/v3/users/cbf7cb234ba04ad18a5786e851e6a52b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.503156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4b5e8-1d58-474d-be07-c06fbb23ed53 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.504452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb403-1a72-46fe-9f83-93f3f85040d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7cb234ba04ad18a5786e851e6a52b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.506761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb403-1a72-46fe-9f83-93f3f85040d2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.513882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 95/194] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/users/cbf7cb234ba04ad18a5786e851e6a52b => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:07.513882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.513882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.513882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.533006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:07.534684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:07.549969 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.550638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.550900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.551177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] PATH_INFO: `/v3/users/cbf7cb234ba04ad18a5786e851e6a52b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.552715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7cb234ba04ad18a5786e851e6a52b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.553822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.555589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 100/195] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/users/cbf7cb234ba04ad18a5786e851e6a52b => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:07.556200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.584074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.613121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 96/196] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:07.613946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.679532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585ada-502a-438f-bc69-5566e4c4833b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.723147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.723772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.724051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.724323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.741614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1519d-bd35-4547-98af-b022db7af7c9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:07.757923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.780400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:07.781170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:07.781523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:07.781871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:07.825534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.827164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.859951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:07.861503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:07.862717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:07.953566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 101/197] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:07.954527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:07.986646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 97/198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:07.991993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.007767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:08.059935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932af0f3-bb56-4b37-b34a-e4e6ea5b9bb3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.085118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:08.096080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.096743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.097046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.097325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.100933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f6e2-a951-4427-8c21-84c504bba357 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.109398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:08.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:08.115247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:08.116029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 102/199] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:08.116674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.138196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.138853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.139141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.139413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.140887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.142343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.144027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 98/200] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:07 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:08.144905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.218486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a245cd-1d95-4233-8c53-cab971b2bf94 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.232565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:08.252290 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756629c-d5a1-4b72-a93d-2c56d7c1c004 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.254542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.255188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.255472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.255750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.256940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.258452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.260370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 103/201] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:08 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:08.261071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.291377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.292035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.292316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.292589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.293460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:08.293767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.295167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.303859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 99/202] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:08.304754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.326306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:08.376271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b654a-47e5-4c36-b53d-1b88bcdf943b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.412319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ebfbd-0141-43d8-a9d2-c37440f5faef None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.412641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.413248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.413526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.413802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.414586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=cbf7cb234ba04ad18a5786e851e6a52b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:08.414893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.416334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.423254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 104/203] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:08 2022] GET /identity/v3/role_assignments?user.id=cbf7cb234ba04ad18a5786e851e6a52b&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:08.424066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.449781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.450429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.450717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.450997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.451817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] RBAC: Adding query filter params (role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=cbf7cb234ba04ad18a5786e851e6a52b) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:08.452134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.453684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.460309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 100/204] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:08 2022] GET /identity/v3/role_assignments?user.id=cbf7cb234ba04ad18a5786e851e6a52b&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:08.546596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b184-911c-4459-8648-18c7ff8b8ac2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.567458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:08.597947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.599110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.599636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.600109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] PATH_INFO: `/v3/users/c9f0ecbf5d9f4d539e66622093e5447b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.601770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] RBAC: Authorizing `identity:get_user(user_id=c9f0ecbf5d9f4d539e66622093e5447b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.603491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.605853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 105/205] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:08 2022] GET /identity/v3/users/c9f0ecbf5d9f4d539e66622093e5447b => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:08.611753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:08.630702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:08.756399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e36dc-c47a-4a6e-baa0-4e80ce141d0d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:08.793812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:08.794439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:08.794765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:08.795052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:08.876268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:08.877794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:08.892972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:09.017432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 101/206] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:09.022869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:09.143624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1b988-00bc-4c28-a43a-0cdfcf6db901 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:09.184859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626bac9-56f9-4015-a788-7b90dbc56f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:09.185861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626bac9-56f9-4015-a788-7b90dbc56f7b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:09.186368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626bac9-56f9-4015-a788-7b90dbc56f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:09.186849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626bac9-56f9-4015-a788-7b90dbc56f7b None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:09.188224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626bac9-56f9-4015-a788-7b90dbc56f7b None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:09.189910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626bac9-56f9-4015-a788-7b90dbc56f7b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:09.191779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 106/207] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:09 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:09.197626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:09.328277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100af5e0-0e95-481c-92f6-858c5c739583 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:09.337835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:09.386379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:09.387702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:09.387984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:09.388253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:09.389081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] RBAC: Adding query filter params (role.id=f89a78d60628474da50e2eae723e655b, scope.project.id=b64bc241f35f424c9a76859c67138857, user.id=c9f0ecbf5d9f4d539e66622093e5447b) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:09.389654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:09.391119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb1c8-1f1b-4c24-9a9d-9d7b608d0278 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:09.397885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 102/208] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:09 2022] GET /identity/v3/role_assignments?user.id=c9f0ecbf5d9f4d539e66622093e5447b&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=f89a78d60628474da50e2eae723e655b => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:09.826596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bf09-f599-4b08-ae89-79769560f17b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:09.827125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bf09-f599-4b08-ae89-79769560f17b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:09.827125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bf09-f599-4b08-ae89-79769560f17b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:09.828782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 107/209] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:09.834169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:09.834585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:09.834752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:09.840900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406081c-c440-4191-9ddf-3fb4927d052b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:09.841184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406081c-c440-4191-9ddf-3fb4927d052b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:09.841462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406081c-c440-4191-9ddf-3fb4927d052b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:09.845583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 108/210] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:09.853566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:09.853855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:09.854134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:09.858237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:09.859437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:09.878596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:09.879953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:09.949790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:09.952271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 103/211] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:09.977595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:09.980665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 109/212] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:10.006079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:10.116270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628b94f-8dea-465e-901a-93d9b26323c0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:10.122865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693db503-b41c-4086-bccd-ff6491b5d007 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:10.124849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:10.155122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:10.156150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.156541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.157599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.158909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:10.160590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:10.164816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 110/213] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:10.169006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:10.171707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:10.172563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.172939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.173288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.184539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:10.189759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:10.190616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:10.191382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:10.195789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 104/214] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:10.197095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:10.227166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:10.290536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2222e6-1d7a-40d5-97fa-17adc1e090db None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:10.310646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3d855-36af-4fb1-8b16-f78ad0ac8c87 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:10.345583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:10.346536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.346886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.347231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.348003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:10.349542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:10.349822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:10.350448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.350731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.351007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.351727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:10.352036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:10.353558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:10.363305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 105/215] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:10.369375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:10.397156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:10.439489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 111/216] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:10 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:20:10.496388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c98dc-1f8e-476e-a4e5-5917660dc8b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:10.535749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3b3e-7289-452b-9162-d9abf0060a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:10.536416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3b3e-7289-452b-9162-d9abf0060a44 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.536701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3b3e-7289-452b-9162-d9abf0060a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.537022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3b3e-7289-452b-9162-d9abf0060a44 None admin] PATH_INFO: `/v3/users/d949781722ae49e890d13535a2ebb9da` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.553632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3b3e-7289-452b-9162-d9abf0060a44 None admin] RBAC: Authorizing `identity:get_user(user_id=d949781722ae49e890d13535a2ebb9da)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:10.555184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3b3e-7289-452b-9162-d9abf0060a44 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:10.557241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 106/217] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:10 2022] GET /identity/v3/users/d949781722ae49e890d13535a2ebb9da => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:10.563507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:10.677021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1daa6-325a-4e9f-b9b3-bef5eafe6f03 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:10.684640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:10.713994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d765c-099f-4058-a2ba-92cee719a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:10.715690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d765c-099f-4058-a2ba-92cee719a381 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.716222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d765c-099f-4058-a2ba-92cee719a381 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.716677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d765c-099f-4058-a2ba-92cee719a381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.795746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d765c-099f-4058-a2ba-92cee719a381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:10.797532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d765c-099f-4058-a2ba-92cee719a381 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:10.845408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d19f6-c862-4fe3-95cc-1ea4f34d6f66 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.846510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d19f6-c862-4fe3-95cc-1ea4f34d6f66 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.846979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d19f6-c862-4fe3-95cc-1ea4f34d6f66 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.848541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 107/218] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:10.856001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ab8e-be64-4190-81a7-2ed5ea3fa18e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.856001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ab8e-be64-4190-81a7-2ed5ea3fa18e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.856239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ab8e-be64-4190-81a7-2ed5ea3fa18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.883508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2251ab8e-be64-4190-81a7-2ed5ea3fa18e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:10.884707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2251ab8e-be64-4190-81a7-2ed5ea3fa18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:10.927517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 112/219] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:10.928780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21cb6-f446-4a92-b2a4-6c2666fb36c0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.929059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21cb6-f446-4a92-b2a4-6c2666fb36c0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.929339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21cb6-f446-4a92-b2a4-6c2666fb36c0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.930897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 113/220] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:10.937525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d21cb6-f446-4a92-b2a4-6c2666fb36c0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:10.947568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:10.973898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 108/221] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:10.975846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:10.976140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:10.976417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:10.996300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:10.997414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:11.005123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.074464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 109/222] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:11.080745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d21cb6-f446-4a92-b2a4-6c2666fb36c0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.080892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.132648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.133730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.134213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.135021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.136888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:11.138797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:11.141919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 114/223] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:10 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:11.142927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.203478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4f259-f1c2-43f3-83cd-d3b0df65d3cf None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.238565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.247181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.248414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.249290 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.249731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.263505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:11.263706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d719e-8897-484b-8cef-d9d304cc4405 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:11.270465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:11.271316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:11.272105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:11.274186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 110/224] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:11.274806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.283861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.313722 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.315139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.315668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.316378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.329884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:11.336639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:11.337529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:11.338301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:11.346939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 115/225] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:11.346939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.412238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafd335-8a1d-434c-a39f-4d873ce14067 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.456286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd329-6ea4-4abd-946f-9eb9b848f870 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.458662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.459196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.459473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.459742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.460768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=d949781722ae49e890d13535a2ebb9da) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:11.460895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:11.462310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:11.468975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 111/226] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/role_assignments?user.id=d949781722ae49e890d13535a2ebb9da&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:11.469808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.506319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.507413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.507932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.508634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.509647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:11.510423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:11.512596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:11.515550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.525188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 116/227] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:11.534654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.610239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.655223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec81b-c344-426d-8078-391d6d6893a7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.693818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.694435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.694711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.694981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.695850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:11.696160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:11.697729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:11.724671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 112/228] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:11.724903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d31ae5-c6eb-4959-b47f-173294b33de8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.725031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.760075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.761897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.762309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.762646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] PATH_INFO: `/v3/users/cbf7cb234ba04ad18a5786e851e6a52b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.764243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7cb234ba04ad18a5786e851e6a52b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:11.766053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:11.768703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 117/229] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/users/cbf7cb234ba04ad18a5786e851e6a52b => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:11.774800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:11.905873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.921047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1153fb-29d9-4797-9aa3-446b14a01eec None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.970230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:11.979839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6654b9-1807-4df2-92ef-a8dd8bcd1cfc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:11.991579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:11.992228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:11.992486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:11.992781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] PATH_INFO: `/v3/users/cbf7cb234ba04ad18a5786e851e6a52b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:11.994033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7cb234ba04ad18a5786e851e6a52b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:11.995541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:11.997399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 113/230] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/users/cbf7cb234ba04ad18a5786e851e6a52b => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:12.002447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:12.046601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:12.047293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.047624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.047904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.049149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:12.050591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:12.052650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 118/231] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:11 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:12.058914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:12.161747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f743e98-84e9-4bde-a272-73b5a05ee08e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:12.171788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6653a6-acc2-475c-896e-b5478714c218 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:12.191901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:12.196599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199ebcf-592a-4bb9-965c-07978154cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:12.197303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199ebcf-592a-4bb9-965c-07978154cec0 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.197584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199ebcf-592a-4bb9-965c-07978154cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.197856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199ebcf-592a-4bb9-965c-07978154cec0 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b/users/cbf7cb234ba04ad18a5786e851e6a52b/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.201190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199ebcf-592a-4bb9-965c-07978154cec0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0009320244aa414cb47742bd5eeff89b, user_id=cbf7cb234ba04ad18a5786e851e6a52b, role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:12.202658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199ebcf-592a-4bb9-965c-07978154cec0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:12.216196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:12.216940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.217225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.217500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.218740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:12.220176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:12.221853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 114/232] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:12 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:12.235666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:12.308632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 119/233] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:12 2022] PUT /identity/v3/projects/0009320244aa414cb47742bd5eeff89b/users/cbf7cb234ba04ad18a5786e851e6a52b/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:12.309878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:12.362428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6640cd-db6d-42cd-a827-b258ff85f283 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:12.410367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6e0fa-9426-4f47-ad1d-dfb09c9ffb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:12.411059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6e0fa-9426-4f47-ad1d-dfb09c9ffb35 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.411341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6e0fa-9426-4f47-ad1d-dfb09c9ffb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.411615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6e0fa-9426-4f47-ad1d-dfb09c9ffb35 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b/users/cbf7cb234ba04ad18a5786e851e6a52b/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.414353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6e0fa-9426-4f47-ad1d-dfb09c9ffb35 None admin] RBAC: Authorizing `identity:create_grant(project_id=0009320244aa414cb47742bd5eeff89b, user_id=cbf7cb234ba04ad18a5786e851e6a52b, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:12.415851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6e0fa-9426-4f47-ad1d-dfb09c9ffb35 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:12.540048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 115/234] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:12 2022] PUT /identity/v3/projects/0009320244aa414cb47742bd5eeff89b/users/cbf7cb234ba04ad18a5786e851e6a52b/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:12.886897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29682c2-8ec9-4a51-b744-7f7c94ba4093 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.887141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29682c2-8ec9-4a51-b744-7f7c94ba4093 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.887607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29682c2-8ec9-4a51-b744-7f7c94ba4093 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.889763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 120/235] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:12.895632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.896002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.896353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.915447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:12.916749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:12.922972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2f97f-92fc-4a61-a83d-bc1304722952 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.923257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2f97f-92fc-4a61-a83d-bc1304722952 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.923529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2f97f-92fc-4a61-a83d-bc1304722952 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.925051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 121/236] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:12.929735 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:12.930021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:12.930303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:12.957743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:12.958942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:13.025654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 116/237] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:13.053230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:13.094608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 122/238] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:13.118577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:13.132972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:13.212224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725cc3c-cb4c-4e59-b199-e0c9d91e4603 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:13.268692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:13.269363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.270479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.270746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.285197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72028d-aa14-4ea0-94c8-b96864718841 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:13.290125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:13.300963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:13.301866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:13.302844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 117/239] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:13.311169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:13.335516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:13.359742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:13.360397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.360676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.360971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.362827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:13.364266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:13.373469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 123/240] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:13.374345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:13.486047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b5945-2989-42c4-9ed9-a189861ea162 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:13.533234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376a1d5-a493-46ee-9900-f06837f6da49 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:13.552475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:13.553133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.553416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.553694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.554391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:13.555835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:13.565086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:13.589276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:13.590043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.590274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.590532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.591298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:13.591605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:13.593044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:13.601750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 118/241] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:13.613719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:13.715402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 124/242] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:13 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:13.716347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3aacb-a0bc-4e91-a14c-db00464a1f91 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:13.754648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a78b9c-bac0-4b4e-ae76-bb044ef0cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:13.755224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a78b9c-bac0-4b4e-ae76-bb044ef0cf03 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.755509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a78b9c-bac0-4b4e-ae76-bb044ef0cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.755780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a78b9c-bac0-4b4e-ae76-bb044ef0cf03 None admin] PATH_INFO: `/v3/users/8e0f8cea50554097b15218a6d5d78d01` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.771481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a78b9c-bac0-4b4e-ae76-bb044ef0cf03 None admin] RBAC: Authorizing `identity:get_user(user_id=8e0f8cea50554097b15218a6d5d78d01)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:13.772997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a78b9c-bac0-4b4e-ae76-bb044ef0cf03 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:13.774738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 119/243] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:13 2022] GET /identity/v3/users/8e0f8cea50554097b15218a6d5d78d01 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:13.781550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:13.864673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:13.896639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2fc01-21c8-4111-bb26-c90d82829fb1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.897292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2fc01-21c8-4111-bb26-c90d82829fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.897762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2fc01-21c8-4111-bb26-c90d82829fb1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.906358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 120/244] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:13.912351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.913048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.913483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:13.931448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd055c-9edd-483b-8bfe-76e47556b0a2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:13.934562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:13.935997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:13.970953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:13.975644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:13.975644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:13.975644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:13.975644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.021655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 121/245] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:14.053769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.060397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.062414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:14.114373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:14.163472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2c185-baff-44ac-8886-6161a9f7445f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.176310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 125/246] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:14.182478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.200068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.200646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.201060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.201343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.212332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:14.219123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:14.220064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:14.220931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 122/247] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:14.227787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.259818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:14.298284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f1864-37f0-43a3-b9ba-b493e0b8d22e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.339578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.340565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.341115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.341730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.343202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.344895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:14.345001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9b41-5450-407c-ae2d-2ec7491db897 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.346995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 126/248] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:14 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:14.353321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.381527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:14.384145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.385174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.385293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.385657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.387276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:14.387688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.389764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:14.399348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 123/249] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:14.405375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.470736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348381b0-8b08-4409-916a-c56cae69032d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.497558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:14.510297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.511687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.512267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.512959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.513921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] RBAC: Adding query filter params (role.id=f89a78d60628474da50e2eae723e655b, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=8e0f8cea50554097b15218a6d5d78d01) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:14.514690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.516285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:14.516672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db7dd6-488b-49be-8c18-bc47638303fe None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.528869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 127/250] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:14 2022] GET /identity/v3/role_assignments?user.id=8e0f8cea50554097b15218a6d5d78d01&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=f89a78d60628474da50e2eae723e655b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:14.557047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.557725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.558141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.558602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] PATH_INFO: `/v3/users/d949781722ae49e890d13535a2ebb9da` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.559996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] RBAC: Authorizing `identity:get_user(user_id=d949781722ae49e890d13535a2ebb9da)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.561670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:14.563666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 124/251] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:14 2022] GET /identity/v3/users/d949781722ae49e890d13535a2ebb9da => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:14.569241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.668803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:14.706252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f0c4-5110-4aca-b4ae-8150f3ffacb1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.755655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752c1aa-4821-4230-91f4-78865369697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.756313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c1aa-4821-4230-91f4-78865369697a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.756604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c1aa-4821-4230-91f4-78865369697a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.756909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c1aa-4821-4230-91f4-78865369697a None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.762130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752c1aa-4821-4230-91f4-78865369697a None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.763600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752c1aa-4821-4230-91f4-78865369697a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:14.765957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 128/252] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:14 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:14.771515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:14.924575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff6c6-6f72-49fc-87e7-8dd6afa5d8ec None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:14.959930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef4d32-6336-415c-ba97-226ad24e670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:14.961030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4d32-6336-415c-ba97-226ad24e670c None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:14.961511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4d32-6336-415c-ba97-226ad24e670c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:14.961992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef4d32-6336-415c-ba97-226ad24e670c None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b/users/d949781722ae49e890d13535a2ebb9da/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:14.964145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef4d32-6336-415c-ba97-226ad24e670c None admin] RBAC: Authorizing `identity:create_grant(project_id=0009320244aa414cb47742bd5eeff89b, user_id=d949781722ae49e890d13535a2ebb9da, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:14.966441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef4d32-6336-415c-ba97-226ad24e670c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:15.062880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb801ea7-0f49-4864-99f9-435e55a2f495 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.063203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb801ea7-0f49-4864-99f9-435e55a2f495 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.063449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb801ea7-0f49-4864-99f9-435e55a2f495 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.064876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 129/253] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:15.071554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb850390-47ea-444d-92d6-dbd66844ffeb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.071841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb850390-47ea-444d-92d6-dbd66844ffeb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.072113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb850390-47ea-444d-92d6-dbd66844ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.084195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 125/254] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:14 2022] PUT /identity/v3/projects/0009320244aa414cb47742bd5eeff89b/users/d949781722ae49e890d13535a2ebb9da/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:15.097636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fb850390-47ea-444d-92d6-dbd66844ffeb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:15.098911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fb850390-47ea-444d-92d6-dbd66844ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:15.176341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 130/255] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:15.203701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e8f11-e904-478a-beef-1aa6f24d30dc None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.204019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e8f11-e904-478a-beef-1aa6f24d30dc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.204265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e8f11-e904-478a-beef-1aa6f24d30dc None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.206114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 126/256] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:15.211588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.211876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.212158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.213899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e8f11-e904-478a-beef-1aa6f24d30dc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:15.232359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:15.233592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:15.245970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:15.312469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 131/257] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:15.338250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:15.347860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:15.452845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fe610-9bca-4103-b0f7-7e635a1f14e9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:15.486541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e8f11-e904-478a-beef-1aa6f24d30dc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:15.491045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:15.491703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.491988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.492264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.504514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:15.509887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:15.510753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:15.511640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 132/258] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:15.517613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:15.544647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:15.545336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.545616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.545887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.560629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:15.570266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:15.571146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:15.571925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 127/259] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:15.577206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:15.593310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:15.632176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36865d7d-db32-4bb3-ae61-51b2a12015ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:15.671926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:15.672654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.672979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.673257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.673980 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:15.674286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:15.675764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:15.688840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 133/260] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:15.690396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:15.713216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:15.737366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37801150-d927-4cef-8345-29ad0e209597 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:15.798833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:15.799457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.799785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.800054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.800850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:15.801156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:15.802581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:15.815712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 128/261] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:15.821231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:15.905446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bcff9-510b-457d-ba6d-ed2efcf57e79 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:15.944350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:15.953920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:15.954726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:15.955011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:15.955286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] PATH_INFO: `/v3/users/cbf7cb234ba04ad18a5786e851e6a52b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:15.956572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7cb234ba04ad18a5786e851e6a52b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:15.958424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:15.963406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 134/262] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/users/cbf7cb234ba04ad18a5786e851e6a52b => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:15.966972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:16.082211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0b72e-9d5f-48ba-80f7-0e8fec82991d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:16.113866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79967cc-0c15-48f4-ba77-54f62c4feacd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:16.122439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:16.123132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:16.123416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:16.123693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:16.156225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:16.157286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:16.157775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:16.158268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] PATH_INFO: `/v3/users/cbf7cb234ba04ad18a5786e851e6a52b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:16.165454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7cb234ba04ad18a5786e851e6a52b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:16.167165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:16.169908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 129/263] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/users/cbf7cb234ba04ad18a5786e851e6a52b => generated 283 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:16.174898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:16.178951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:16.200654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:16.208556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:16.216886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:16.317191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e9f32-52f0-4965-b335-5da8aabb3177 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:16.343189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 135/264] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:16.344449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:16.397428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:16.398306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:16.398736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:16.399149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:16.446274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:16.453308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100326-a246-4eab-b3d4-6dba35d4e404 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:16.541453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:16.542176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:16.543017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:16.543387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:16.544923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:16.546358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:16.552751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 136/265] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:16 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:16.554028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:16.588177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:16.590533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:16.608755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:16.796853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e0e7-a936-4f86-9cc2-32ad50e7cf96 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:16.826464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 130/266] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:20:16.831679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:16.872763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:16.873388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:16.873668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:16.873940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:16.874737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] RBAC: Adding query filter params (role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=cbf7cb234ba04ad18a5786e851e6a52b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:16.875044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:16.876497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:16.890180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 137/267] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:16 2022] GET /identity/v3/role_assignments?user.id=cbf7cb234ba04ad18a5786e851e6a52b&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:16.983935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db15ba-4592-4d41-875a-e1d47b40a7c4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:16.990002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:17.037602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa335e5-15b6-4916-b417-3ee50abeddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:17.038269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa335e5-15b6-4916-b417-3ee50abeddcf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.038548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa335e5-15b6-4916-b417-3ee50abeddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.038820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa335e5-15b6-4916-b417-3ee50abeddcf None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.040078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa335e5-15b6-4916-b417-3ee50abeddcf None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:17.041568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa335e5-15b6-4916-b417-3ee50abeddcf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:17.044239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 131/268] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:16 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:17.050019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:17.083510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:17.158458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1d0a-ba69-47dd-be08-f2f0defd1713 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.159001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1d0a-ba69-47dd-be08-f2f0defd1713 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.159001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1d0a-ba69-47dd-be08-f2f0defd1713 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.160334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 132/269] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:17.170571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.170863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.171107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.195318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:17.196532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:17.202771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85142e4-777e-4e39-aaaa-259bfb3fdcd1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:17.248774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:17.249669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.250090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.250506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.252194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=cbf7cb234ba04ad18a5786e851e6a52b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:17.252670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:17.254269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:17.261863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 138/270] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:17 2022] GET /identity/v3/role_assignments?user.id=cbf7cb234ba04ad18a5786e851e6a52b&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:17.296153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 133/271] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:17.319945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:17.424107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:17.436380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d1649-631f-435d-954f-efbf3a6dd865 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:17.477820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c34042-52b5-4fca-9039-ceb85b94dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:17.478468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c34042-52b5-4fca-9039-ceb85b94dc99 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.478748 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c34042-52b5-4fca-9039-ceb85b94dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.479028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c34042-52b5-4fca-9039-ceb85b94dc99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.496489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c34042-52b5-4fca-9039-ceb85b94dc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a1c34042-52b5-4fca-9039-ceb85b94dc99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:17.501581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:17.502481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:17.503255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 139/272] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:17.508924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:17.549951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892ed2-715b-46f0-a22d-33c72d39ae11 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.550570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892ed2-715b-46f0-a22d-33c72d39ae11 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.551039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892ed2-715b-46f0-a22d-33c72d39ae11 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.552591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 140/273] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:17.559275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.559665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.560045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.579664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:17.581669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:17.644634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30026-27de-4fa2-b56c-b73aa47dd860 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:17.646717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:17.676053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 141/274] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:17.693747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:17.694801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.695276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.695833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.697969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:17.698551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:17.700345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:17.707217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:17.713536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 134/275] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:17.721772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:17.815515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:17.834786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f088d3-b528-4d53-b7f8-3f59ac2410e4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:17.837867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6569-f276-4b46-bb95-455ff1ed0c60 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:17.872395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ad61-9dae-4b2f-a38f-8d3dc99a4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:17.873111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ad61-9dae-4b2f-a38f-8d3dc99a4e41 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.873394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8fe9-9927-4fc7-9471-b63cfc0cff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:17.873506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ad61-9dae-4b2f-a38f-8d3dc99a4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.873660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ad61-9dae-4b2f-a38f-8d3dc99a4e41 None admin] PATH_INFO: `/v3/users/3a0f1ed4d9874777a0c4487a908090a3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.874038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8fe9-9927-4fc7-9471-b63cfc0cff76 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.874503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8fe9-9927-4fc7-9471-b63cfc0cff76 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.874785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8fe9-9927-4fc7-9471-b63cfc0cff76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.875994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf8fe9-9927-4fc7-9471-b63cfc0cff76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:17.877588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf8fe9-9927-4fc7-9471-b63cfc0cff76 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:17.883664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 142/276] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:17.883664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c08f6-7137-4143-ab0a-5bbcf74f2751 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.883664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c08f6-7137-4143-ab0a-5bbcf74f2751 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.883664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c08f6-7137-4143-ab0a-5bbcf74f2751 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.883664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 143/277] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:17.886610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c08f6-7137-4143-ab0a-5bbcf74f2751 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:17.892451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ad61-9dae-4b2f-a38f-8d3dc99a4e41 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0f1ed4d9874777a0c4487a908090a3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:17.893959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ad61-9dae-4b2f-a38f-8d3dc99a4e41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:17.895809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 135/278] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:17 2022] GET /identity/v3/users/3a0f1ed4d9874777a0c4487a908090a3 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:17.896876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:17.897162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:17.897437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:17.915602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:17.916826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:17.935552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:17.989050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 136/279] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:17.993285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.002788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c08f6-7137-4143-ab0a-5bbcf74f2751 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.037825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a093a5-9e2b-480e-a446-9dc92c988c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.038446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a093a5-9e2b-480e-a446-9dc92c988c61 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.038728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a093a5-9e2b-480e-a446-9dc92c988c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.039013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a093a5-9e2b-480e-a446-9dc92c988c61 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.039697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a093a5-9e2b-480e-a446-9dc92c988c61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:18.041165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a093a5-9e2b-480e-a446-9dc92c988c61 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:18.102355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a97ba1-5d84-40b6-89a7-acf0b35c66be None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.135345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.135983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.136263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.136534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.137347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, user.id=3a0f1ed4d9874777a0c4487a908090a3, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:18.137658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:18.139398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:18.144242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 137/280] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Jul 27 08:20:17 2022] GET /identity/v3/role_assignments?user.id=3a0f1ed4d9874777a0c4487a908090a3&scope.system=all&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:18.145056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.162511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 144/281] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:17 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:20:18.168487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:18.273555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeac4b1-0ad5-4819-80a8-7dc9e884d1a2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.306076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405a60c-3eeb-4d30-960f-bc23d5851eab None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.306616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405a60c-3eeb-4d30-960f-bc23d5851eab None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.306616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405a60c-3eeb-4d30-960f-bc23d5851eab None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.312698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 145/282] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:18.314522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.314811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.315083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.318268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.319265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.319553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.319823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.330843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:18.334208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:18.339807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:18.344976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:18.346172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 138/283] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:18.346824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:18.346824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:18.347524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.430434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 146/284] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:18.443558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:18.454712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.471904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b674f0-586a-4eb1-8dd2-39bab506ff62 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.524567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.525482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.525762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.526035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.527539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:18.527891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:18.529351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:18.538449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 139/285] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:18.544058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.596592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416dc2-ff48-4b27-a2b4-22947a2f5982 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.637158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.637807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.638080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.639391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.643472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:18.655615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:18.661076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:18.661968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:18.663153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 147/286] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:18.668274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.692213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400aba-02e1-4860-ad4d-c92e05c1d397 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.756297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.756981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.757304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.757583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] PATH_INFO: `/v3/users/8e0f8cea50554097b15218a6d5d78d01` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.758834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] RBAC: Authorizing `identity:get_user(user_id=8e0f8cea50554097b15218a6d5d78d01)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:18.760424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:18.762182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 140/287] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/users/8e0f8cea50554097b15218a6d5d78d01 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:18.768075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.782213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:18.789049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93635-eaa7-4bca-b3d8-a5e107f790ca None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.825458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:18.826079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:18.826359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:18.826633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:18.827347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:18.827652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:18.829075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:18.837659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 148/288] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:18.844489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:18.945653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:18.950020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38fcc4-effa-4748-a5dd-869fa2cbdbfc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:18.999842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b8d7-e99c-4748-a357-7f260f7310a2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:19.024088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:19.024997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:19.025439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:19.025849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:19.028902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:19.030524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:19.032342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 141/289] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:19.039737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:19.073935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:19.074585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:19.074863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:19.075692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] PATH_INFO: `/v3/users/d949781722ae49e890d13535a2ebb9da` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:19.077412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] RBAC: Authorizing `identity:get_user(user_id=d949781722ae49e890d13535a2ebb9da)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:19.078856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:19.080459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 149/290] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:18 2022] GET /identity/v3/users/d949781722ae49e890d13535a2ebb9da => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:19.087204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:19.177784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:19.220361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845740a8-d38d-4e78-bfbd-352f7cd7c902 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:19.279475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa87c0-7501-4181-902c-7000360d5c26 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:19.287657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:19.288330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:19.288606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:19.288903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b/users/8e0f8cea50554097b15218a6d5d78d01/roles/f89a78d60628474da50e2eae723e655b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:19.294268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] RBAC: Authorizing `identity:create_grant(project_id=0009320244aa414cb47742bd5eeff89b, user_id=8e0f8cea50554097b15218a6d5d78d01, role_id=f89a78d60628474da50e2eae723e655b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:19.295748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:19.319573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:19.328411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:19.329062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:19.329337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:19.329611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:19.391977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 142/291] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:19 2022] PUT /identity/v3/projects/0009320244aa414cb47742bd5eeff89b/users/8e0f8cea50554097b15218a6d5d78d01/roles/f89a78d60628474da50e2eae723e655b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:19.412366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:19.413902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:19.525453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 150/292] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:19.532225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:19.645790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bbf14-b9c0-42b2-9251-de8e118d7dbc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:19.684931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ca778-d53b-4cd6-bb06-771b4c72be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:19.685574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca778-d53b-4cd6-bb06-771b4c72be4a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:19.685853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca778-d53b-4cd6-bb06-771b4c72be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:19.686125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca778-d53b-4cd6-bb06-771b4c72be4a None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:19.687283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca778-d53b-4cd6-bb06-771b4c72be4a None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:19.688761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca778-d53b-4cd6-bb06-771b4c72be4a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:19.690705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 143/293] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:19 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:19.696633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:19.738993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:19.842021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8f87-3604-4dfd-999d-5813cd936afe None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:19.895522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:19.896166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:19.896452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:19.896745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:19.897557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=d949781722ae49e890d13535a2ebb9da) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:19.897868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:19.899313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bee51-16f2-43e5-8df0-0921defc16bf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:19.910057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 151/294] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:19 2022] GET /identity/v3/role_assignments?user.id=d949781722ae49e890d13535a2ebb9da&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:20.377814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b65c8-049c-4293-aef6-7902d571c312 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.378502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b65c8-049c-4293-aef6-7902d571c312 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.378502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b65c8-049c-4293-aef6-7902d571c312 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.380019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 144/295] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:20.385335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.385885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.386571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.405672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:20.406866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:20.486199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 152/296] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:20.510000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b65c8-049c-4293-aef6-7902d571c312 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:20.517543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:20.642402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b65c8-049c-4293-aef6-7902d571c312 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:20.677372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7474dd-6e7f-47d1-b337-f01494b396ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:20.678061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7474dd-6e7f-47d1-b337-f01494b396ae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.678343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7474dd-6e7f-47d1-b337-f01494b396ae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.678618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7474dd-6e7f-47d1-b337-f01494b396ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.689113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7474dd-6e7f-47d1-b337-f01494b396ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ae7474dd-6e7f-47d1-b337-f01494b396ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:20.695317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:20.697383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:20.700041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:20.705613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 145/297] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:20.705760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:20.726028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:20.768375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcab2a-889f-49b7-be0a-65ed719382d4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.768696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcab2a-889f-49b7-be0a-65ed719382d4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.768937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcab2a-889f-49b7-be0a-65ed719382d4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.770575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 146/298] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:20.776045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.776045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.776351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.805972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:20.809072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:20.821338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b6a0-22cd-4f86-a3ac-bda58ccff314 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:20.872837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:20.874347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.874904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.875730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.878280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:20.879411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:20.882205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:20.882462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab4ae0-ea31-4353-a8e8-74712c397230 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:20.904839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 147/299] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:20.905005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 153/300] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:20.905082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:20.919104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df615-7634-4228-a1d8-7f66b8201122 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:20.919400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df615-7634-4228-a1d8-7f66b8201122 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:20.919656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df615-7634-4228-a1d8-7f66b8201122 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:20.923596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 154/301] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:20.925012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df615-7634-4228-a1d8-7f66b8201122 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:21.013436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40830ed1-e15b-4c61-8d37-c312fd6d9361 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.024275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:21.050714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f56a3-aa77-4b6c-aa66-41faa8b8f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.050953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df615-7634-4228-a1d8-7f66b8201122 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.051568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f56a3-aa77-4b6c-aa66-41faa8b8f113 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.051672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f56a3-aa77-4b6c-aa66-41faa8b8f113 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.051951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f56a3-aa77-4b6c-aa66-41faa8b8f113 None admin] PATH_INFO: `/v3/users/3a0f1ed4d9874777a0c4487a908090a3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.053882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f56a3-aa77-4b6c-aa66-41faa8b8f113 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0f1ed4d9874777a0c4487a908090a3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:21.055325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f56a3-aa77-4b6c-aa66-41faa8b8f113 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:21.056964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 148/302] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:20 2022] GET /identity/v3/users/3a0f1ed4d9874777a0c4487a908090a3 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:21.058082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.058380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.058655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.077934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:21.079118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:21.098419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.099346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.099778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.100233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.101565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:21.103165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:21.105909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 155/303] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:21.106860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:21.149115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:21.164840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 149/304] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:21.164840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:21.235356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0282-1b70-489b-ac0e-346d90f91702 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.273387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.274068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.274349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.274627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] PATH_INFO: `/v3/system/users/3a0f1ed4d9874777a0c4487a908090a3/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.276104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a0f1ed4d9874777a0c4487a908090a3, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:21.278284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:21.287194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5179c-4d52-4961-bbb0-bcc008e01cca None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.329514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.330164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.330490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.330738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] PATH_INFO: `/v3/groups` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.331409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:21.332909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:21.391480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 156/305] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Jul 27 08:20:21 2022] PUT /identity/v3/system/users/3a0f1ed4d9874777a0c4487a908090a3/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:21.393456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:21.412840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:21.434390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 150/306] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Jul 27 08:20:21 2022] POST /identity/v3/groups => generated 229 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:21.537288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4ab4-4527-497f-83c4-a5802f5cca0c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.582200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.582885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.583169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.583448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.597355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:21.602742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:21.603672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:21.604601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 157/307] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:21.612014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:21.673012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:21.732162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092ef1-3956-4c5d-a39f-b00c39b71bf3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.769451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.770084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.770351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.770629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.771345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:21.771647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:21.774356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2bb1-6e9c-4ab7-86e7-cffd571bd0bb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:21.784946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 151/308] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:21.791809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:21.831184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f163cc-94ba-4e17-a934-28398628c8c5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.831671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f163cc-94ba-4e17-a934-28398628c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.832149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f163cc-94ba-4e17-a934-28398628c8c5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.834769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 152/309] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:21.841573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.842058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.842471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.874557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:21.876615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:21.884604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:21.913862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1e7b-25e7-4be3-8a8d-af10ad8e9f73 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:21.954920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:21.955739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:21.956119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:21.956491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] PATH_INFO: `/v3/users/7c9f3cc5c36146e9b1afc9c47ad500ba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:21.975413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9f3cc5c36146e9b1afc9c47ad500ba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:21.977370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:21.978291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:21.980782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 158/311] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:21 2022] GET /identity/v3/users/7c9f3cc5c36146e9b1afc9c47ad500ba => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:21.987407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:22.001874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:22.032631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:22.092899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f43cf-286b-429d-818f-d5daa0f8bd81 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:22.129242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:22.129870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:22.130149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:22.130422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:22.131208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] RBAC: Adding query filter params (role.id=f89a78d60628474da50e2eae723e655b, user.id=7c9f3cc5c36146e9b1afc9c47ad500ba, scope.system=all) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:22.131516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:22.132981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:22.134617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c339bd7-2b1d-42c0-9280-e231e8780d36 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:22.145030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 154/312] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Jul 27 08:20:21 2022] GET /identity/v3/role_assignments?user.id=7c9f3cc5c36146e9b1afc9c47ad500ba&scope.system=all&role.id=f89a78d60628474da50e2eae723e655b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:22.172141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:22.178626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:22.179677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:22.180160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:22.180627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:22.194540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:22.200453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:22.201835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:22.202671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:22.210005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 159/313] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:22.211808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:22.323739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255d89e-f108-4d01-9b1c-15be813ab90b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:22.331299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:22.359726 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:22.360347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:22.360633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:22.361010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:22.361727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:22.362031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:22.363408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:22.377060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 155/314] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:22.378405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:22.487660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd9989-b9f2-437a-b8eb-641093854df4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:22.525243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:22.525895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:22.526179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:22.526527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] PATH_INFO: `/v3/users/8e0f8cea50554097b15218a6d5d78d01` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:22.528013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8e0f8cea50554097b15218a6d5d78d01)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:22.529493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:22.531118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 160/315] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:22 2022] GET /identity/v3/users/8e0f8cea50554097b15218a6d5d78d01 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:22.536944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:22.644598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559cb77-c0d9-41a2-852c-8de6e8e6c0f5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:22.680628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:22.681335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:22.681618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:22.681943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:22.718881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:22.755630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:22.757120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:22.860401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 156/316] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:22.865907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:22.929732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:22.972525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ce710-60e9-4a7b-8609-6761e0ef42c2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:23.006714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d44d7a-6505-4b45-b6a1-72d0c1ef8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:23.007359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d44d7a-6505-4b45-b6a1-72d0c1ef8e7a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.007641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d44d7a-6505-4b45-b6a1-72d0c1ef8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.007917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d44d7a-6505-4b45-b6a1-72d0c1ef8e7a None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.009091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d44d7a-6505-4b45-b6a1-72d0c1ef8e7a None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:23.010521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d44d7a-6505-4b45-b6a1-72d0c1ef8e7a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:23.013345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 161/317] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:22 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:23.019306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:23.089476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:23.123494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d415-e44e-420f-ba63-b5cf1231cbb6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:23.160046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:23.160752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.161037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.161314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.162141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] RBAC: Adding query filter params (role.id=f89a78d60628474da50e2eae723e655b, scope.project.id=0009320244aa414cb47742bd5eeff89b, user.id=8e0f8cea50554097b15218a6d5d78d01) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:23.162458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:23.163918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ca33-c420-4add-bb29-6af035676fb9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:23.170857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 157/318] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:23 2022] GET /identity/v3/role_assignments?user.id=8e0f8cea50554097b15218a6d5d78d01&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=f89a78d60628474da50e2eae723e655b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:23.517410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55856adc-9481-424e-a573-b221f63a4fe4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.517861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55856adc-9481-424e-a573-b221f63a4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.518049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55856adc-9481-424e-a573-b221f63a4fe4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.519486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 162/319] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:23.524369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5375d4-3d03-4309-bfec-4922b943456d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.524658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5375d4-3d03-4309-bfec-4922b943456d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.524971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5375d4-3d03-4309-bfec-4922b943456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.544289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6d5375d4-3d03-4309-bfec-4922b943456d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:23.545502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6d5375d4-3d03-4309-bfec-4922b943456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:23.613804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 158/320] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:23.637290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55856adc-9481-424e-a573-b221f63a4fe4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:23.638242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e7bd-a483-46ac-9f06-bcd8f0e02174 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.638526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e7bd-a483-46ac-9f06-bcd8f0e02174 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.639040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6e7bd-a483-46ac-9f06-bcd8f0e02174 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.640384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 159/321] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:23.645172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.645454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.645726 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.663535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:23.664704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:23.733374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:23.741924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55856adc-9481-424e-a573-b221f63a4fe4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:23.744786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 160/322] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:23.767859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:23.773945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:23.782533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:23.783178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.783467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.783744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.795178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:23.800261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:23.801377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:23.805072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 163/323] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:23.807371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:23.883039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa8aff-d7b6-43e8-9938-c0a3881d1aad None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:23.913199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4fdf7-dac4-450d-944b-61ac450a0a14 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:23.920008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:23.921097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.921398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.921676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.923223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:23.925105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:23.931189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 161/324] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:23.932119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:23.955070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:23.955692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:23.955976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:23.956253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:23.957101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:23.957314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:23.958692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:23.967944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 164/325] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:23.973290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:23.996308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:24.027182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:24.041092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab480-ef9b-4c88-b3fa-ff57ff1d6bbc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:24.078490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde307-0179-436e-a298-6977ca566771 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:24.082980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1041945-e952-46ef-a6f7-d366ad9ebf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:24.083602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1041945-e952-46ef-a6f7-d366ad9ebf31 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.083889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1041945-e952-46ef-a6f7-d366ad9ebf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.084163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1041945-e952-46ef-a6f7-d366ad9ebf31 None admin] PATH_INFO: `/v3/groups` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.084848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1041945-e952-46ef-a6f7-d366ad9ebf31 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:24.086791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1041945-e952-46ef-a6f7-d366ad9ebf31 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:24.113749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:24.114389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.114672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.114945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] PATH_INFO: `/v3/users/3a0f1ed4d9874777a0c4487a908090a3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.116114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0f1ed4d9874777a0c4487a908090a3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:24.117596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:24.119202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 165/326] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:23 2022] GET /identity/v3/users/3a0f1ed4d9874777a0c4487a908090a3 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:24.124946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:24.180395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 162/327] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Jul 27 08:20:23 2022] POST /identity/v3/groups => generated 226 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:24.235368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9bf9-a89e-46f6-bc8b-c32a36338ee8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:24.254865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:24.270306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5fbf-edc1-4df8-ab7e-1f6c2e0f6b65 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.270602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5fbf-edc1-4df8-ab7e-1f6c2e0f6b65 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.270862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5fbf-edc1-4df8-ab7e-1f6c2e0f6b65 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.272469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 163/328] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:24.273917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:24.274556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.274835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.275106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.275898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] RBAC: Adding query filter params (role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, user.id=3a0f1ed4d9874777a0c4487a908090a3, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:24.276295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:24.278539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:24.278870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.279160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.279434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.300899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 166/329] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Jul 27 08:20:24 2022] GET /identity/v3/role_assignments?user.id=3a0f1ed4d9874777a0c4487a908090a3&scope.system=all&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:24.302061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:24.303343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:24.385111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 164/330] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:24.409182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:24.525909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55fdac-3abe-443d-920c-003347ff3f59 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:24.563107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:24.563689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.563975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.564260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.574979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:24.580359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:24.581316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:24.582096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:24.587389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:24.643012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:24.693900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14026-d96e-4a52-b7fb-9d2b0ab596d8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:24.734363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:24.734990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.735270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.735536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.736263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:24.736566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:24.738083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:24.747099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 165/332] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:24.752599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:24.791485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:24.873938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67184f-43ff-4eb7-8dcc-224be4357ef1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:24.911501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f948d1-0f47-4b4d-ae56-2d890bc5faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:24.912154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f948d1-0f47-4b4d-ae56-2d890bc5faa0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:24.912437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f948d1-0f47-4b4d-ae56-2d890bc5faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:24.912713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f948d1-0f47-4b4d-ae56-2d890bc5faa0 None admin] PATH_INFO: `/v3/users/7c9f3cc5c36146e9b1afc9c47ad500ba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:24.913905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f948d1-0f47-4b4d-ae56-2d890bc5faa0 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9f3cc5c36146e9b1afc9c47ad500ba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:24.915344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f948d1-0f47-4b4d-ae56-2d890bc5faa0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:24.917972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 168/333] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:24 2022] GET /identity/v3/users/7c9f3cc5c36146e9b1afc9c47ad500ba => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:24.923345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:25.050675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e23149-0ba3-4d11-9ac9-56cf0047aa0f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:25.068609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:25.091436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823833f-6122-4b7b-92d1-478f5cd15439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:25.092106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823833f-6122-4b7b-92d1-478f5cd15439 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:25.092391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823833f-6122-4b7b-92d1-478f5cd15439 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:25.092667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823833f-6122-4b7b-92d1-478f5cd15439 None admin] PATH_INFO: `/v3/system/users/7c9f3cc5c36146e9b1afc9c47ad500ba/roles/f89a78d60628474da50e2eae723e655b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:25.095984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823833f-6122-4b7b-92d1-478f5cd15439 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7c9f3cc5c36146e9b1afc9c47ad500ba, role_id=f89a78d60628474da50e2eae723e655b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:25.097440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823833f-6122-4b7b-92d1-478f5cd15439 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:25.202312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 166/334] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Jul 27 08:20:24 2022] PUT /identity/v3/system/users/7c9f3cc5c36146e9b1afc9c47ad500ba/roles/f89a78d60628474da50e2eae723e655b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:26.810666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360806-a1c2-421c-8e7a-8b0b4191a056 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:26.811150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360806-a1c2-421c-8e7a-8b0b4191a056 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:26.811150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360806-a1c2-421c-8e7a-8b0b4191a056 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:26.812486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 169/335] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:26.817999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a942d-ecbc-41f5-9c65-2b7f6cb15efb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:26.818400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a942d-ecbc-41f5-9c65-2b7f6cb15efb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:26.818562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a942d-ecbc-41f5-9c65-2b7f6cb15efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:26.858848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-882a942d-ecbc-41f5-9c65-2b7f6cb15efb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:26.860361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-882a942d-ecbc-41f5-9c65-2b7f6cb15efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:26.938187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 167/336] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:26.954714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ec66-609b-41d1-b06e-cc167d0a8ab5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:26.955003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ec66-609b-41d1-b06e-cc167d0a8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:26.955271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ec66-609b-41d1-b06e-cc167d0a8ab5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:26.956637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 170/337] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:26.962236 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65de9-a19f-47ea-89f8-3fc54004eb89 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:26.962524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65de9-a19f-47ea-89f8-3fc54004eb89 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:26.962804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65de9-a19f-47ea-89f8-3fc54004eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:26.968971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ec66-609b-41d1-b06e-cc167d0a8ab5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:26.992552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e8e65de9-a19f-47ea-89f8-3fc54004eb89 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:26.993890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e8e65de9-a19f-47ea-89f8-3fc54004eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:27.107586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 168/338] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:27.108957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08fb98-0f91-48b5-81f3-be5e0dbefaf9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.109243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08fb98-0f91-48b5-81f3-be5e0dbefaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.109885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08fb98-0f91-48b5-81f3-be5e0dbefaf9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.111468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 169/339] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:27.116861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.117142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.117413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.149678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:27.150851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:27.158173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ec66-609b-41d1-b06e-cc167d0a8ab5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:27.164891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:27.212039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:27.235945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:27.236605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.237237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.237237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.258634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:27.263345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 170/340] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:27.264594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:27.272767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:27.273849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:27.274808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 171/341] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:27.286345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:27.465227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f301b-b8a3-40a1-912e-0ba657d131ec None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:27.486483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783027-426b-4c4c-b1eb-f3c1a6d50cc3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:27.535379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:27.536022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.536296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.536564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.556999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:27.558645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.558941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.559198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.559953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:27.560264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:27.561881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:27.565762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:27.567502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:27.568341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:27.569465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:27.571624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 171/342] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:27.572646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:27.585100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 172/343] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:27.585974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:27.608383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:27.662164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:27.699420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f93003-63dd-416f-82af-9afd05a6a4c9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:27.742047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:27.743558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.744049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.745137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.758136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:27.765251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:27.766127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:27.767402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:27.769599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 172/344] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:27.772956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:27.850951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b64c39-7c25-4e4a-b056-091e22ec88e4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:27.883764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:27.893658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:27.894261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.894616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.894871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:27.895593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:27.895906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:27.897296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:27.905365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad7f2f-b8a5-4011-96a3-56b5e50aa6ea None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:27.909169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 173/345] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:27.910063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:27.959084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14296df1-2bc4-440b-9429-9b6cc6304a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:27.959828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14296df1-2bc4-440b-9429-9b6cc6304a0e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:27.960144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14296df1-2bc4-440b-9429-9b6cc6304a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:27.960487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14296df1-2bc4-440b-9429-9b6cc6304a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.039488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14296df1-2bc4-440b-9429-9b6cc6304a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:28.041005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.041184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14296df1-2bc4-440b-9429-9b6cc6304a0e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:28.061169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27c76b-d1a9-4d1f-99be-d381d94f42df None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:28.102841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:28.103580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.103931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.104843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.105942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:28.106246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:28.107691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23277c-2be5-4a99-829e-3612051b7c82 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:28.122970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 174/346] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:28.122970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200610f-5acc-466f-953d-32204b9cc842 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.122970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200610f-5acc-466f-953d-32204b9cc842 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.122970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200610f-5acc-466f-953d-32204b9cc842 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.122970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 175/347] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:28.123536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200610f-5acc-466f-953d-32204b9cc842 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.161009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.181817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 173/348] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:28.183457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.183741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.184010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.207298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:28.208547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:28.256347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200610f-5acc-466f-953d-32204b9cc842 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:28.285094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 174/349] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:28.285963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.303583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796312e-3593-4d35-bf56-588391123115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:28.304776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796312e-3593-4d35-bf56-588391123115 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.305500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796312e-3593-4d35-bf56-588391123115 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.305973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796312e-3593-4d35-bf56-588391123115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.332822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.399446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796312e-3593-4d35-bf56-588391123115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:28.403017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796312e-3593-4d35-bf56-588391123115 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:28.416298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1b2b1-4549-445e-8f20-796111671dfd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:28.440919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.466276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:28.466906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.467300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.467465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.532096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 176/350] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:28.532991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796312e-3593-4d35-bf56-588391123115 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.569125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:28.571202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:28.600078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.670600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796312e-3593-4d35-bf56-588391123115 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:28.704666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 175/351] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:28.705765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.716149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bae57a-ca60-4b08-a29a-770f94389d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:28.717211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bae57a-ca60-4b08-a29a-770f94389d79 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.717492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bae57a-ca60-4b08-a29a-770f94389d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.717802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bae57a-ca60-4b08-a29a-770f94389d79 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.718968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bae57a-ca60-4b08-a29a-770f94389d79 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:28.720408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bae57a-ca60-4b08-a29a-770f94389d79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:28.722101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 177/352] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:28.723232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eefeac-8af9-40fd-bec3-4baed5ac6d47 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.723510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eefeac-8af9-40fd-bec3-4baed5ac6d47 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.723849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eefeac-8af9-40fd-bec3-4baed5ac6d47 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.725258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 178/353] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:28.725804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eefeac-8af9-40fd-bec3-4baed5ac6d47 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.731178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.821968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3078a-b69a-489b-a79e-7e7e269d48b6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:28.846419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eefeac-8af9-40fd-bec3-4baed5ac6d47 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:28.860672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049229f8-05aa-4c96-b8dd-42c1ed1850b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:28.861347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049229f8-05aa-4c96-b8dd-42c1ed1850b5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.861623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049229f8-05aa-4c96-b8dd-42c1ed1850b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.861893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049229f8-05aa-4c96-b8dd-42c1ed1850b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.866210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:28.874474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049229f8-05aa-4c96-b8dd-42c1ed1850b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-049229f8-05aa-4c96-b8dd-42c1ed1850b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:28.879825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:28.880705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:28.882119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 176/354] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:28.882806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519368-b4b4-48d1-ac53-f40f179a7952 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.882879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519368-b4b4-48d1-ac53-f40f179a7952 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.883111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519368-b4b4-48d1-ac53-f40f179a7952 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.884338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 177/355] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:28.885053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f519368-b4b4-48d1-ac53-f40f179a7952 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.895191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:28.896159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:28.896670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:28.897024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:28.898190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:28.899635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:28.901412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 179/356] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:28.902165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:28.980591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.007047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f519368-b4b4-48d1-ac53-f40f179a7952 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.028364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a3a51-5ad1-4534-b657-69874c5c3d2f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.048985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1973287-849e-4e48-8dc2-61e4348a0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.052123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1973287-849e-4e48-8dc2-61e4348a0c3b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.052123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1973287-849e-4e48-8dc2-61e4348a0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.052123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1973287-849e-4e48-8dc2-61e4348a0c3b None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.052123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1973287-849e-4e48-8dc2-61e4348a0c3b None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.052783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1973287-849e-4e48-8dc2-61e4348a0c3b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.055181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 178/357] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:29.058758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9555b-8a67-4019-b265-af212f5ac5e4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.059384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9555b-8a67-4019-b265-af212f5ac5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.059661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9555b-8a67-4019-b265-af212f5ac5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.067319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.067319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.067557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.067747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.077492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.078880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.080208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3fe9555b-8a67-4019-b265-af212f5ac5e4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:29.082684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3fe9555b-8a67-4019-b265-af212f5ac5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:29.082800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 180/358] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:28 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:29.082800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.139075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.166362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 179/359] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:29.168049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.168556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.168861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.188388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:29.189231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:29.199060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9427-4e63-4ce2-90f9-0fa5445cc4eb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.240338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.241421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.241874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.242316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.243221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:29.243693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.246357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.255214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 181/360] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:29.256372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.269733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 180/361] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:29.270590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.273676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.388079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef7c24-0806-475a-bc8c-6fbd43623348 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.394768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f83e34-8645-4e6f-85d3-115ba06f95c2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.402871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.426986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.427646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.427932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.428219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.429390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.430825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.433118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 182/362] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:29.434021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.441598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.444614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.444614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.444614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.444614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.445470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.447149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 181/363] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:29.447950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.538021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.568376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb303c5-7409-4f1c-9fce-e814b977f963 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.578456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58b3a0-2aa7-4fa7-89cb-d8983829225f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.608868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.609756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.610199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.610472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.611621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=b64bc241f35f424c9a76859c67138857) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:29.611621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.613066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.619546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 183/364] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:29.620994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.624319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.625039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.625322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.625596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.640804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:29.646062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:29.647016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 182/365] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:29.648697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.689565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.772322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54bb3-fb2e-423e-86ec-5d0efe4b95f2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.794949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546424b5-e88a-4b8c-a4fe-1f220acc899a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:29.823926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.824560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.824933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.825215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.828097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.833887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:29.834534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:29.834813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:29.835748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:29.850500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:29.856438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:29.857554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:29.858709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 183/366] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:29.859559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:29.915087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:29.916503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:29.964165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:29.976636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74863347-69c8-494b-acb4-d66e2589dee3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.012773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.013433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.013984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.014262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.015052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=0009320244aa414cb47742bd5eeff89b) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:30.015364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.016832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.021541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 184/367] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:30.022217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.036751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 184/368] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:29 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.036751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.106261 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:30.157367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5c39f-d446-455c-a6d0-927a2a5ad57b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.171349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d81c2c-a00f-42a7-9b91-3f3f2a749a73 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.208335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.208889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.210792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.210792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.210792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=b64bc241f35f424c9a76859c67138857) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:30.210792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.213037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.216780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.217409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.217694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.217969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.218688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:30.218998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.220386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.220888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 185/369] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.222031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.230370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 185/370] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.231270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.241432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:30.407551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9c10a-4ea0-42f5-86ce-afb91aec35b7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.421652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d70e0-4fad-46ee-8547-0120d3d0c272 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.429031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:30.448551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.455152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.455152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.455152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.455152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.455152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.455964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 186/371] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.456977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.459917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.460552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.460873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.461154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.461886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:30.462215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.464192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.473089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 186/372] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.481686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.613351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6c700-6778-41e6-9851-33bf998fa88e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.620765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:30.654038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff892-8f2e-4c19-ae15-c5f878ce8225 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.677872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.678430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.681115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.681404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.708533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.709671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.710161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.710653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.715304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.717015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.725148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 187/373] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.725148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.761578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:30.777337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.778881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.920752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca5988-55d9-4410-b818-ea6aaa01be41 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:30.956779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 187/374] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:30.957548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:30.983744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:30.984401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:30.984689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:30.985055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] PATH_INFO: `/v3/users/7c9f3cc5c36146e9b1afc9c47ad500ba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:30.986375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9f3cc5c36146e9b1afc9c47ad500ba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:30.987826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:30.989474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 188/375] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/users/7c9f3cc5c36146e9b1afc9c47ad500ba => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:30.990237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:31.009061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:31.113103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:31.141450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28714dbf-b738-4fd3-b463-3ac6fd4a82ff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:31.174999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90a06-61be-44d2-8878-7275e4d1fa59 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:31.205113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:31.205787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.206068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.206342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.207185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=0009320244aa414cb47742bd5eeff89b) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:31.207439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:31.209052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:31.209574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:31.210217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.210502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.210779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] PATH_INFO: `/v3/projects/f286f6bca46449aebb8b762b4e1748f9` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.211948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] RBAC: Authorizing `identity:get_project(project_id=f286f6bca46449aebb8b762b4e1748f9)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:31.214032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:31.215778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 189/376] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/projects/f286f6bca46449aebb8b762b4e1748f9 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:31.216542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:31.223215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 188/377] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:30 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:31.224071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:31.298873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:31.326158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc901d-b3e9-403b-a8c4-07ce8e658c54 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:31.365607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:31.366239 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.366527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.366806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.367610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] RBAC: Adding query filter params (role.id=f89a78d60628474da50e2eae723e655b, user.id=7c9f3cc5c36146e9b1afc9c47ad500ba, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:31.368550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:31.370173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:31.385321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 190/378] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Jul 27 08:20:31 2022] GET /identity/v3/role_assignments?user.id=7c9f3cc5c36146e9b1afc9c47ad500ba&scope.system=all&role.id=f89a78d60628474da50e2eae723e655b => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:31.467194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861af6-b515-47e9-ac6c-ab564371e273 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:31.528176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e13465-55cb-4411-9793-a1eb5dad5851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:31.528859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e13465-55cb-4411-9793-a1eb5dad5851 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.529142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e13465-55cb-4411-9793-a1eb5dad5851 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.529418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e13465-55cb-4411-9793-a1eb5dad5851 None admin] PATH_INFO: `/v3/groups/3cb9d23c8194472da610158806baeb6e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.536118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e13465-55cb-4411-9793-a1eb5dad5851 None admin] RBAC: Authorizing `identity:get_group(group_id=3cb9d23c8194472da610158806baeb6e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:31.537700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e13465-55cb-4411-9793-a1eb5dad5851 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:31.539728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 189/379] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:31 2022] GET /identity/v3/groups/3cb9d23c8194472da610158806baeb6e => generated 229 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:31.546170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:31.676589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e3a5-4567-4600-b3df-5dfccec8f312 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:31.717124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:31.721448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:31.722024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.722311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.722596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.723396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] RBAC: Adding query filter params (group.id=3cb9d23c8194472da610158806baeb6e, role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=f286f6bca46449aebb8b762b4e1748f9) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:31.723713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:31.725189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c23b2-40c0-4c85-bdfe-a579905fc4ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:31.731903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 191/380] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:31 2022] GET /identity/v3/role_assignments?group.id=3cb9d23c8194472da610158806baeb6e&scope.project.id=f286f6bca46449aebb8b762b4e1748f9&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:31.893329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c0ad-f26d-4699-943c-3a44442f6aad None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.893677 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c0ad-f26d-4699-943c-3a44442f6aad None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.893958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c0ad-f26d-4699-943c-3a44442f6aad None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.895685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 190/381] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:31.902654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:31.902989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:31.903224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:31.929983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:31.931226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:32.016218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 192/382] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:32.040056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582c0ad-f26d-4699-943c-3a44442f6aad None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:32.058948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:32.149654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582c0ad-f26d-4699-943c-3a44442f6aad None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:32.185924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:32.186676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.186964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.187240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.198174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:32.203767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:32.205836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:32.207773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 191/383] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:32.214877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:32.321021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4d94-3148-4094-9ab3-9e55854f4154 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:32.348539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:32.357851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:32.358480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.358767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.359045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.359771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:32.360080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:32.361566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:32.371702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 193/384] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:32.377424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:32.473388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:32.486474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfba5a-62e2-4ce7-8871-f9f351141f41 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:32.522338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977fbfa-dbfc-4f7a-a889-f52307fe4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:32.522990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fbfa-dbfc-4f7a-a889-f52307fe4ead None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.523272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fbfa-dbfc-4f7a-a889-f52307fe4ead None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.523552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fbfa-dbfc-4f7a-a889-f52307fe4ead None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.524974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977fbfa-dbfc-4f7a-a889-f52307fe4ead None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:32.526887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977fbfa-dbfc-4f7a-a889-f52307fe4ead None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:32.528711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 192/385] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:32 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:32.534080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:32.640669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8e0b-4449-4153-8dc5-ae25cb9b8ca5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:32.645484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32883e-9134-40e4-aa9f-dda2e6520a41 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.645773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32883e-9134-40e4-aa9f-dda2e6520a41 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.646054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32883e-9134-40e4-aa9f-dda2e6520a41 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.647654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 193/386] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:32.652922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.653207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.653485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.673493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:32.674740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:32.680611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:32.681291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.681577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.681858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.683627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:32.685190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:32.687046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 194/387] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:32 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:32.700003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:32.768023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 194/388] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:32.793264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:32.816209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:32.863978 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4357-dfc7-4833-8f2c-23dfe7c439c6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:32.935735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:32.939546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:32.940266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:32.940548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:32.940881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:32.942845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] RBAC: Authorizing `identity:create_grant(project_id=b64bc241f35f424c9a76859c67138857, group_id=6a7d1f419a31431c9ba2b948de6cf1a0, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:32.947319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:32.990620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcefc41-c7e2-460d-982c-5bf05d6cf977 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.028224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af772bae-eb0c-46bd-a583-97bc5cf9e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.028903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772bae-eb0c-46bd-a583-97bc5cf9e9cf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.029184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772bae-eb0c-46bd-a583-97bc5cf9e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.029455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772bae-eb0c-46bd-a583-97bc5cf9e9cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.040124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af772bae-eb0c-46bd-a583-97bc5cf9e9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:33.049052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 195/389] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Jul 27 08:20:32 2022] PUT /identity/v3/projects/b64bc241f35f424c9a76859c67138857/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-af772bae-eb0c-46bd-a583-97bc5cf9e9cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:33.053338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:33.055264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:33.056376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 195/390] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:33.061406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.137946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2268-c69e-4351-914c-ef9d8799872b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.138233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2268-c69e-4351-914c-ef9d8799872b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.138771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2268-c69e-4351-914c-ef9d8799872b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.140424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 196/391] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:33.145861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.146151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.146400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.176141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:33.176141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:33.245435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996f9b-5c07-4871-aa47-b00efc16f881 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.265649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:33.282341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 197/392] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:33.288607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.289324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.289608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.289884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.290663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:33.290970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:33.293125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:33.302990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 196/393] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:33.309370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.312928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.386802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:33.430718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04340-61c8-4d5b-b6b4-1fa89d378c44 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.436229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a9e5e-a58c-4162-8700-a1c64ef1f435 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.471883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.472764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.472882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.473252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.473464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.473711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.473820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.474006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.475165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:33.476862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:33.478596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 198/394] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:33.488895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:33.489690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:33.494320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:33.499450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:33.501525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 197/395] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:33.515440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.562400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:33.626287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b932-3a59-43bb-85b5-7b348b4655a4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.663951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.664581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.664927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.665209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.665925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:33.666231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:33.668285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:33.677249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 198/396] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:33.684459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.720932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bebc-ead3-4e85-8590-aa5463937d79 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.790577 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:33.809549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.810367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.810654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.810927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.812940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:33.814412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:33.817081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 199/397] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:33.817482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:33.820835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e441c-47cd-4b85-8de9-131f7b6d898f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:33.821715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:33.863007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:33.864503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:33.865023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:33.865503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:33.866893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:33.868780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:33.871061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 199/398] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:33.878278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.020010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa97e1f-23cf-4abf-95c6-2f9a98cfe004 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.059563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b39c-9e83-4599-882c-acdeb32bf43a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.076628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bafdba-0d9e-4648-8225-ea573bc96744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.077771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bafdba-0d9e-4648-8225-ea573bc96744 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.078259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bafdba-0d9e-4648-8225-ea573bc96744 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.078739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bafdba-0d9e-4648-8225-ea573bc96744 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.081028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bafdba-0d9e-4648-8225-ea573bc96744 None admin] RBAC: Authorizing `identity:create_grant(project_id=0009320244aa414cb47742bd5eeff89b, group_id=6a7d1f419a31431c9ba2b948de6cf1a0, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:34.082702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bafdba-0d9e-4648-8225-ea573bc96744 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:34.095124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533faf15-e779-49a8-8a27-946ddcd33c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.095784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533faf15-e779-49a8-8a27-946ddcd33c93 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.096109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533faf15-e779-49a8-8a27-946ddcd33c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.096326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533faf15-e779-49a8-8a27-946ddcd33c93 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.097521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533faf15-e779-49a8-8a27-946ddcd33c93 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:34.098965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533faf15-e779-49a8-8a27-946ddcd33c93 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:34.100719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 200/399] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:33 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:34.101784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccf1c-adc9-4d51-b780-f9b4273ec726 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.102066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccf1c-adc9-4d51-b780-f9b4273ec726 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.108128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccf1c-adc9-4d51-b780-f9b4273ec726 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.108128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 201/400] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:34.108128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ccf1c-adc9-4d51-b780-f9b4273ec726 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.147064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:34.164982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 200/401] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Jul 27 08:20:33 2022] PUT /identity/v3/projects/0009320244aa414cb47742bd5eeff89b/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:20:34.167627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.168282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.168662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.217074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:34.218644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:34.235227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ccf1c-adc9-4d51-b780-f9b4273ec726 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.277164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a004b-2d64-4b56-a094-90aace56d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.278150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a004b-2d64-4b56-a094-90aace56d3d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.278658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a004b-2d64-4b56-a094-90aace56d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.279096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a004b-2d64-4b56-a094-90aace56d3d1 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.287304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a004b-2d64-4b56-a094-90aace56d3d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b64bc241f35f424c9a76859c67138857, group_id=6a7d1f419a31431c9ba2b948de6cf1a0, role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:34.289311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a004b-2d64-4b56-a094-90aace56d3d1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:34.329267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:34.340933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:34.363852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.410296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 202/403] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Jul 27 08:20:34 2022] PUT /identity/v3/projects/b64bc241f35f424c9a76859c67138857/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:20:34.480090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f3047-c8d5-4761-bcf4-23b8ffff7197 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.511250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ba6ce-7620-4299-bf0e-ee2587264591 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.511557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ba6ce-7620-4299-bf0e-ee2587264591 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.511811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ba6ce-7620-4299-bf0e-ee2587264591 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.513751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 203/404] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:34.519429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.519727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.520010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.525444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.527037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.527560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.528031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.540423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:34.546891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:34.547883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:34.548668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:34.551650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 202/405] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:34.558224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.577933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:34.579179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:34.621209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:34.672820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cecd6-c36e-4316-b0fe-09d9caffcfa6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.688481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 204/406] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:34.716003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.716957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.717374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.717816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.718678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:34.719129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:34.720676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:34.723264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.730745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 203/407] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:34.736372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.771000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:34.855789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9393d-a02b-442e-a414-92575d9cccb0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.875743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac2c7-1610-4d2b-9e87-932011b9d3fd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:34.893732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:34.902012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.905867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.905867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.905867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.923829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:34.928884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:34.929769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:34.930585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 205/408] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:34.941710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:34.947052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:34.948380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:34.948696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:34.948961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:34.950136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:34.951576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:34.953554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 204/409] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:34 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:34.965729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:35.096944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:35.116631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63590c-cbcb-40da-bc8a-644bff7fe93d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.148065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558aac20-e51b-4311-8b0b-5265f087cba3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.169516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.170121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.170407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.170687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.171417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:35.171724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:35.173138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:35.189228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 206/410] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:35.194595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.195268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.195557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.195833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.197281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:35.198836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:35.200302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:35.201993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 205/411] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:34 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:35.207686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:35.336137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7fe2-72e4-42df-9491-1e3efd06993e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.344223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:35.377338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b02c69-089e-47d9-bd29-7e36553afbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.378017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b02c69-089e-47d9-bd29-7e36553afbb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.378304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b02c69-089e-47d9-bd29-7e36553afbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.378585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b02c69-089e-47d9-bd29-7e36553afbb5 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.380942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b02c69-089e-47d9-bd29-7e36553afbb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0009320244aa414cb47742bd5eeff89b, group_id=6a7d1f419a31431c9ba2b948de6cf1a0, role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:35.382389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b02c69-089e-47d9-bd29-7e36553afbb5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:35.402913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce284cb2-6e82-460d-aace-b8405bc93af6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.440653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.441395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.441678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.441974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] PATH_INFO: `/v3/groups/3cb9d23c8194472da610158806baeb6e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.443178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] RBAC: Authorizing `identity:get_group(group_id=3cb9d23c8194472da610158806baeb6e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:35.444683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:35.446616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 207/412] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:35 2022] GET /identity/v3/groups/3cb9d23c8194472da610158806baeb6e => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:35.452709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:35.473318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:35.529068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 206/413] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Jul 27 08:20:35 2022] PUT /identity/v3/projects/0009320244aa414cb47742bd5eeff89b/groups/6a7d1f419a31431c9ba2b948de6cf1a0/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:35.537499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7fef-2ff9-471c-bb0c-9d9e99c3124f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.537844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7fef-2ff9-471c-bb0c-9d9e99c3124f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.538127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a7fef-2ff9-471c-bb0c-9d9e99c3124f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.540834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 207/414] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:35.552027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.552369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.553312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.594307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179ca1-29c5-4ddd-a223-24b0ef5de4ed None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.595811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:35.597320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:35.668142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.669296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.670710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.671198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] PATH_INFO: `/v3/projects/f286f6bca46449aebb8b762b4e1748f9` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.673899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] RBAC: Authorizing `identity:get_project(project_id=f286f6bca46449aebb8b762b4e1748f9)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:35.677442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:35.681322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 208/415] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:35 2022] GET /identity/v3/projects/f286f6bca46449aebb8b762b4e1748f9 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:35.687115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:35.735386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 208/416] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:35.766587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:35.806043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:35.813591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:35.833114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb54b3-6de8-484f-93d9-b0626f49de0f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.879275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.879976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.880256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.880533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] PATH_INFO: `/v3/projects/f286f6bca46449aebb8b762b4e1748f9/groups/3cb9d23c8194472da610158806baeb6e/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.886480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] RBAC: Authorizing `identity:create_grant(project_id=f286f6bca46449aebb8b762b4e1748f9, group_id=3cb9d23c8194472da610158806baeb6e, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:35.887957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:35.928062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f584-1fec-4d63-89fe-258efbcde893 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:35.965616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:35.966278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:35.966551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:35.966827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:35.978005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:35.989969 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 209/417] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Jul 27 08:20:35 2022] PUT /identity/v3/projects/f286f6bca46449aebb8b762b4e1748f9/groups/3cb9d23c8194472da610158806baeb6e/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:35.990692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:35.991608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:35.992437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:35.993098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 209/418] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:35.998858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:36.172808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633c2b-4a15-40a9-a623-fb5ba550dd9c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:36.217277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:36.217846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:36.218130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:36.218404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:36.219134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:36.219439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:36.220835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e0c87-40e8-4c34-a53b-d8a0db3c80a2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:36.230607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 210/419] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:36.235830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:36.382113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:36.389875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f880-8c66-452f-8e43-891a05ac7ae6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:36.438322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:36.439334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:36.439816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:36.440288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:36.548403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:36.549902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:36.673953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17e95-306e-4076-aea9-1bbebbf8a23a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:36.674274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17e95-306e-4076-aea9-1bbebbf8a23a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:36.675017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17e95-306e-4076-aea9-1bbebbf8a23a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:36.676380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 211/420] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:36.681459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:36.681780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:36.682060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:36.689096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:36.694986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:36.697698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 210/421] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:36.712865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:36.713557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:36.713654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:36.810513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 212/422] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:36.860183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c633-f5b2-4493-953f-6c4f9eccb3b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:36.870151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:36.902339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:36.903362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:36.903857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:36.904334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:36.905728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:36.907375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:36.909563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 211/423] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:36 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:36.921757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:36.997858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.022138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9f630-0b5c-495c-a3ab-a3f0dab187ae None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.037510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d959e-6e8b-4174-913d-7d5ce05c1183 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.069466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177112c-d116-4906-8283-ccfe07678c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.070305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177112c-d116-4906-8283-ccfe07678c7a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.070594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177112c-d116-4906-8283-ccfe07678c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.070872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177112c-d116-4906-8283-ccfe07678c7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.074424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.075180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4719c-bb64-4913-8471-c7d70d8c4992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.076209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4719c-bb64-4913-8471-c7d70d8c4992 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.076706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4719c-bb64-4913-8471-c7d70d8c4992 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.077223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4719c-bb64-4913-8471-c7d70d8c4992 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.078558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4719c-bb64-4913-8471-c7d70d8c4992 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:37.080202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4719c-bb64-4913-8471-c7d70d8c4992 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:37.082128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 212/424] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:36 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:37.085443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177112c-d116-4906-8283-ccfe07678c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:37.085565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fc5b0-0ffe-427b-acc1-851575322744 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.085565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fc5b0-0ffe-427b-acc1-851575322744 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.085565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fc5b0-0ffe-427b-acc1-851575322744 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.085565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 213/425] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:37.089934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fc5b0-0ffe-427b-acc1-851575322744 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a177112c-d116-4906-8283-ccfe07678c7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:37.090646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:37.091653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:20:37.092773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:37.095042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 213/426] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:37.098372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.098838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.099255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.124269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:37.126374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:37.208910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fc5b0-0ffe-427b-acc1-851575322744 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.218588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 214/427] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:37.220481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.261280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.267135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.267857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.268269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.268637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.269904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=b64bc241f35f424c9a76859c67138857) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:37.270167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:37.271754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:37.278722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 214/428] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:37.280196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.392007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd934f8b-21bd-4a48-886b-db8f8a432918 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.435036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.449425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.450629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.450915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.451193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.452995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:37.453330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:37.455716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:37.467374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8b3c6-d67b-45bf-8b8c-d5e611120960 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.468591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 215/429] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:37.475896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.532895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.533576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.533847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.534119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.546902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:37.552574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:37.553542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:37.554322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:37.555534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 215/430] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:37.561785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.625484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e27b4-234b-411a-8ae7-61c50883d6c0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.646305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.681235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.683044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.683542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.684024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.712486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6da58-ffe1-4aa3-8412-3e6adbaba20a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.763667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.764339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.764619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.764973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:37.765911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:37.766215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:37.767097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.769326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:37.779905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 216/431] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:37.783443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:37.785270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:37.785400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.891728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 216/432] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:37.898435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:37.898887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c6704-86b6-4dc7-a351-cefe8adc338a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:37.918375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:37.937189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc241-c16c-49a2-a055-d180f6b7882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:37.937819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc241-c16c-49a2-a055-d180f6b7882a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:37.938162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc241-c16c-49a2-a055-d180f6b7882a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:37.938354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc241-c16c-49a2-a055-d180f6b7882a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.022336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc241-c16c-49a2-a055-d180f6b7882a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.023820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc241-c16c-49a2-a055-d180f6b7882a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.024997 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.046988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731b73-2da9-4134-9cc3-1b90dbe84489 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.086653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1780734-853a-41d2-ab94-5a7594ca7877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.087299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1780734-853a-41d2-ab94-5a7594ca7877 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.087584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1780734-853a-41d2-ab94-5a7594ca7877 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.087900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1780734-853a-41d2-ab94-5a7594ca7877 None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.089325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1780734-853a-41d2-ab94-5a7594ca7877 None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.090768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1780734-853a-41d2-ab94-5a7594ca7877 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.092442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 217/433] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:38.093603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd28f4-62ed-4409-9d6e-2b1cbbe897e9 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.093890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd28f4-62ed-4409-9d6e-2b1cbbe897e9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.094168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd28f4-62ed-4409-9d6e-2b1cbbe897e9 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.099471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 218/434] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:38.100247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd28f4-62ed-4409-9d6e-2b1cbbe897e9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.149807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 217/435] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:20:38.149807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.149807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.149807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.165399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:38.166701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:38.181160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.210955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd28f4-62ed-4409-9d6e-2b1cbbe897e9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.237815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 218/436] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:38.238567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.255318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.257371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.257851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.258564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.260839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.263027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.265654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 219/437] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:38.266974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.295066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.347599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d88cb-4767-45d1-ac30-fba3031aecc4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.376974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc64f0-b5a5-43be-b7fb-bc3fc227a6d6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.387313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.387966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.388822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.389101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] PATH_INFO: `/v3/projects/b64bc241f35f424c9a76859c67138857` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.390432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] RBAC: Authorizing `identity:get_project(project_id=b64bc241f35f424c9a76859c67138857)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.391858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.393758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 219/438] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/projects/b64bc241f35f424c9a76859c67138857 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:38.394295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.413628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.418716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.419366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.425889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.425889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.430871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:38.436433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:38.437386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:38.438158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 220/439] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:38.438809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.509011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eeeda-e6cc-458e-b47d-2c9b63c1a16b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.530401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.544862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.545477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.545721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8f5a5-5871-4393-b127-13222ee2d0c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.545826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.546018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.546798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49, scope.project.id=0009320244aa414cb47742bd5eeff89b) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:38.547113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.548533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.554529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 220/440] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:38.555135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.598825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d341b-330b-401a-9bea-ce0c0b668049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.599488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d341b-330b-401a-9bea-ce0c0b668049 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.599772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d341b-330b-401a-9bea-ce0c0b668049 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.600052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d341b-330b-401a-9bea-ce0c0b668049 None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.601658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d341b-330b-401a-9bea-ce0c0b668049 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.602814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d341b-330b-401a-9bea-ce0c0b668049 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.604966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 221/441] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:38.606120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38741-118a-4ff0-9fb7-e293c887cc7a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.606321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38741-118a-4ff0-9fb7-e293c887cc7a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.606599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38741-118a-4ff0-9fb7-e293c887cc7a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.607836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 222/442] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:38.612635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38741-118a-4ff0-9fb7-e293c887cc7a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.648073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.671241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7eaa5-15b9-48c3-829a-24ff6b7f08e1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.715902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.720190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.720190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.720190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.720190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:38.720190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.720190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ab53a-b9e1-473a-bf23-7bbe15d1ead4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.729045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 221/443] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:38.729852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.730145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.730422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.742544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38741-118a-4ff0-9fb7-e293c887cc7a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.751453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:38.752670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:38.782081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.782752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.783043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.783319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.784107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=b64bc241f35f424c9a76859c67138857) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:38.784415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:38.785884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:38.791785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 223/444] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=b64bc241f35f424c9a76859c67138857&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:38.792570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.815626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.836309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 222/445] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:38.860015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:38.908754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbed72-f81e-49c6-ad69-892756dd30dd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:38.935983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:38.950171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:38.950796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:38.951686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:38.951686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:38.969630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30c58-bf2b-4116-9c39-e8292da7371c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.010704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.011344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.011626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.011899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.024135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:39.029673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:39.030572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:20:39.031381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:39.032093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.032164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 223/446] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:39.034271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.036979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.056900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.153657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f08d4b-2d78-4b24-b8d3-2debeb20422f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.161017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 224/447] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:39.167516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.189075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.194039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.194660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.194945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.195218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.195935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:39.196243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.198250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.207572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 224/448] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:39.214196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.283896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff757d-b2a3-47a1-aeed-af6db16ad4dd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.305798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.324532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54d92-eaed-4668-97c6-f0eff5508326 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.326498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.327144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.327430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.327706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] PATH_INFO: `/v3/projects/0009320244aa414cb47742bd5eeff89b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.328939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] RBAC: Authorizing `identity:get_project(project_id=0009320244aa414cb47742bd5eeff89b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.330368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.332168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 225/449] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/projects/0009320244aa414cb47742bd5eeff89b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:39.337573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.358380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.358988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.359267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.359539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.419175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.426814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.428840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.438961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b0f8-8bed-4765-8a87-5ee2c55f024c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.471759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.472323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.472611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.472912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] PATH_INFO: `/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.474045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] RBAC: Authorizing `identity:get_group(group_id=6a7d1f419a31431c9ba2b948de6cf1a0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.475462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.477073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 226/450] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/groups/6a7d1f419a31431c9ba2b948de6cf1a0 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:39.482917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.528543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 225/451] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:20:39.534025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.538196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.585486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eadb8-68b2-4ada-bd41-b9da9fa3c9ae None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.617814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.618424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.618711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.618986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.620420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] RBAC: Adding query filter params (group.id=6a7d1f419a31431c9ba2b948de6cf1a0, role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=0009320244aa414cb47742bd5eeff89b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:39.620761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.622196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.625777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.627884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 227/452] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/role_assignments?group.id=6a7d1f419a31431c9ba2b948de6cf1a0&scope.project.id=0009320244aa414cb47742bd5eeff89b&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:39.631263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40509de-d71c-4c25-b1ef-49d28c964cc2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.668939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.669594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.669874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.670145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] PATH_INFO: `/v3/projects/f286f6bca46449aebb8b762b4e1748f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.671338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] RBAC: Authorizing `identity:get_project(project_id=f286f6bca46449aebb8b762b4e1748f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.672835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.674589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 226/453] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/projects/f286f6bca46449aebb8b762b4e1748f9 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:39.680718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.786028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e378105-e112-4c7d-af40-2eae02fcdd76 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.802473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:39.820289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eec15-855a-47a3-9c5e-b309dab720aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.820947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eec15-855a-47a3-9c5e-b309dab720aa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.821232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eec15-855a-47a3-9c5e-b309dab720aa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.821508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eec15-855a-47a3-9c5e-b309dab720aa None admin] PATH_INFO: `/v3/groups/3cb9d23c8194472da610158806baeb6e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.823193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eec15-855a-47a3-9c5e-b309dab720aa None admin] RBAC: Authorizing `identity:get_group(group_id=3cb9d23c8194472da610158806baeb6e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.824837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eec15-855a-47a3-9c5e-b309dab720aa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.826434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 228/454] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/groups/3cb9d23c8194472da610158806baeb6e => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:39.832320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:39.933471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0081b-63ea-4ba0-8571-91de7852ee98 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:39.967833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:39.968447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:39.968749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:39.969027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:39.969810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] RBAC: Adding query filter params (group.id=3cb9d23c8194472da610158806baeb6e, role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=f286f6bca46449aebb8b762b4e1748f9) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:39.970116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:39.971549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01998b0-d0ff-442b-a1b1-3abbda835f41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:39.977349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 227/455] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Jul 27 08:20:39 2022] GET /identity/v3/role_assignments?group.id=3cb9d23c8194472da610158806baeb6e&scope.project.id=f286f6bca46449aebb8b762b4e1748f9&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:42.414088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba650c9-e82f-4294-8342-9b3f7df13625 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.415042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba650c9-e82f-4294-8342-9b3f7df13625 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.415522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba650c9-e82f-4294-8342-9b3f7df13625 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.417443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 229/456] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:42.422611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51817f-e00a-4d82-adad-5ca10cf8cf60 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.423430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51817f-e00a-4d82-adad-5ca10cf8cf60 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.423903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51817f-e00a-4d82-adad-5ca10cf8cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.445703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6f51817f-e00a-4d82-adad-5ca10cf8cf60 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:42.447885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6f51817f-e00a-4d82-adad-5ca10cf8cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:42.471363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:42.539210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 228/457] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:42.575993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba650c9-e82f-4294-8342-9b3f7df13625 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:42.630462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0336-f6cc-41bb-bf06-ad4903dbf539 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.631108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0336-f6cc-41bb-bf06-ad4903dbf539 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.631773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0336-f6cc-41bb-bf06-ad4903dbf539 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.635724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 229/458] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:42.642879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea902e-bb97-44a6-b689-0ed2230ac34a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.643403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea902e-bb97-44a6-b689-0ed2230ac34a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.643886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea902e-bb97-44a6-b689-0ed2230ac34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.688685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fcea902e-bb97-44a6-b689-0ed2230ac34a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:42.690203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fcea902e-bb97-44a6-b689-0ed2230ac34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:42.714255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba650c9-e82f-4294-8342-9b3f7df13625 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:42.762668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:42.763583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.763924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.764210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.777361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:42.778840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2e2013b7-57e3-4473-80ce-867b10995b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:42.794937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:42.795834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:42.796685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:42.796685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:42.796685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:42.796685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:42.797363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 230/459] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:42.798293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad73e95-2eb1-47c1-9e21-474164bbe729 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.798581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad73e95-2eb1-47c1-9e21-474164bbe729 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.798858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad73e95-2eb1-47c1-9e21-474164bbe729 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.799399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 230/460] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:42.804183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 231/461] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:42.805263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad73e95-2eb1-47c1-9e21-474164bbe729 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:42.806080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.806689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.807171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.826200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:42.827777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:42.865429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:42.911948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 231/462] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:42.921094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:42.921329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:42.939117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad73e95-2eb1-47c1-9e21-474164bbe729 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:42.980910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:42.981550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:42.981812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:42.982084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:42.983140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:42.983342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:42.984717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.003555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 232/463] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:43.004415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.047407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0b28-7364-44bb-8b3e-ac4efeb43aef None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.091346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.091992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.092277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.092555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.105985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.107456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:43.125324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:43.126176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:43.127024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:43.127024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:43.127024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:43.127024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:43.127249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772c7c-1070-4f36-8a9a-fb1e866cdb95 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.129531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 232/464] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:43.130527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.152778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:43.171555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.172194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.180869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.180869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.183643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.185181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.192533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:43.205208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:43.206141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:43.206975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:43.206975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:43.206975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:43.206975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:43.206975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 233/465] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:43.207711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.254664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb183a-551b-434a-b47c-69d7c060e64c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.293121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77426b-8953-46d1-bb1f-7029b8380d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.293747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77426b-8953-46d1-bb1f-7029b8380d27 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.294034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77426b-8953-46d1-bb1f-7029b8380d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.294312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77426b-8953-46d1-bb1f-7029b8380d27 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.295001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77426b-8953-46d1-bb1f-7029b8380d27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.296433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77426b-8953-46d1-bb1f-7029b8380d27 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.317335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e8ea-9a9d-4f0f-9566-a8c9349492df None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.351172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.351791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.352121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.352397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.353184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:43.353530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.359044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.366869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 234/466] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:43.367671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.425993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:43.428896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 233/467] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:43 2022] POST /identity/v3/users => generated 246 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:43.430480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51aa39-ea0d-42ad-afbc-288f9ae0c19e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.430774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51aa39-ea0d-42ad-afbc-288f9ae0c19e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.431049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51aa39-ea0d-42ad-afbc-288f9ae0c19e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.437529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 234/468] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:43.438477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51aa39-ea0d-42ad-afbc-288f9ae0c19e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.498815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47867fc9-d9b7-43f8-b83f-45134caaf5f5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.544711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:43.554582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.555553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.555956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.556951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.557962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:43.562155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.562155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478a03e-89fe-497d-9348-3ed0b873fc7e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.576492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51aa39-ea0d-42ad-afbc-288f9ae0c19e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.580204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 235/469] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:43.581688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.582040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.582321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.603971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:43.605702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:43.618622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.619610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.619610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.619869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.620493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.622033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.683981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 236/470] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:43.684642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.708228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 235/471] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:43 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:43.720963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.748548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:43.821762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0806bd-51fa-453c-ae27-ac15c38bc69d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.855707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077938bf-5db0-4c43-b5ee-c389ec254f1c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:43.869686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2adbe-fb46-488d-b06a-fa9710fee00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.870826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2adbe-fb46-488d-b06a-fa9710fee00e None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.871307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2adbe-fb46-488d-b06a-fa9710fee00e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.871799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2adbe-fb46-488d-b06a-fa9710fee00e None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.872693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2adbe-fb46-488d-b06a-fa9710fee00e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.874600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2adbe-fb46-488d-b06a-fa9710fee00e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.892378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:43.898009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:43.898661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.898953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.900038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.910976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:43.912533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2170fac2-61c9-43b3-b05a-fca15cfd0eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:43.930326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:43.931228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:43.933420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:43.933420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:43.933420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:43.933420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:43.933420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 236/472] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:43.933870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3151f-7593-4ff9-a234-2581343f42af None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.934226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3151f-7593-4ff9-a234-2581343f42af None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.934512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3151f-7593-4ff9-a234-2581343f42af None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:43.939758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 237/473] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:43.939895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3151f-7593-4ff9-a234-2581343f42af None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:43.985891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 237/474] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:43 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:43.987946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:43.988882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:43.989382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:44.017186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:44.019000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:44.070322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3151f-7593-4ff9-a234-2581343f42af None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:44.112099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:44.113121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:44.113621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:44.114100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:44.115041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:44.115554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:44.117191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:44.133667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 238/475] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:44.140162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:44.150338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 238/476] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:44.186153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:44.209119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:44.231563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:44.269993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff9991-2fae-46dd-b38c-bd93fb3998f8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:44.309194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:44.309897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:44.310192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:44.310469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:44.311161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:44.313520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:44.317891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a2be6-0165-4d62-909c-2beac4a9aa45 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:44.357081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:44.357708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:44.357991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:44.358263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:44.359002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:44.360399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:44.397566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 239/477] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:44 2022] POST /identity/v3/users => generated 249 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:44.412045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.sql.core [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 08:20:44.412045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 08:20:44.412045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [parameters: {'id': '01d890cb92584d0b9dae34e0e8b31da9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 08:20:44.412045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80327) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 27 08:20:44.433835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:20:44.435170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application yield resource Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise self.value Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application session.commit() Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 08:20:44.436088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.session.flush() Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application compat.raise_( Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 08:20:44.437012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:20:44.437936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application result.read() Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:20:44.438763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [parameters: {'id': '01d890cb92584d0b9dae34e0e8b31da9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:44.439543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 08:20:44.440329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:44.443205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 239/478] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Jul 27 08:20:44 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:44.450137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:44.609454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:44.613978 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa93a-f193-436d-9422-de86a24c35f7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:44.651138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d585b5-6277-4aa8-8fd0-5a7266d48c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:44.652131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d585b5-6277-4aa8-8fd0-5a7266d48c8e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:44.652691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d585b5-6277-4aa8-8fd0-5a7266d48c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:44.653033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d585b5-6277-4aa8-8fd0-5a7266d48c8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:44.664018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d585b5-6277-4aa8-8fd0-5a7266d48c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-09d585b5-6277-4aa8-8fd0-5a7266d48c8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:44.669330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:44.670185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:44.670967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:20:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:44.677782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:44.786357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:44.789897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f293c-3dc7-439e-8d68-3a4546b02722 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:44.827328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:44.827954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:44.828239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:44.828512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:44.829288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:44.829594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:44.830974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00d92-9176-474c-94a5-79c6f6dd3267 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:44.839748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 240/480] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:45.942701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3deb27-9aca-473a-a44e-ed34abcb6db4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:45.943212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3deb27-9aca-473a-a44e-ed34abcb6db4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:45.943212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3deb27-9aca-473a-a44e-ed34abcb6db4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:45.944662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 241/481] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:45.949817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:45.950629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:45.951220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:45.972608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:45.974120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:46.066079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f93d3-73fb-4ccb-8b93-55598708348b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.066411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f93d3-73fb-4ccb-8b93-55598708348b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.066666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f93d3-73fb-4ccb-8b93-55598708348b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.068123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 242/482] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:46.071544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 241/483] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:46.074582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.074582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.074582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.101929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:46.102490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:46.104471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:46.220328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:46.231213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114bfe2-9090-4721-98a4-7ebb34d6b36e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:46.254046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 243/484] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:46.281415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:46.282324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.282776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.283217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.294640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:46.299708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:46.300553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:46.301384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:46.304254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 242/485] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:46.308772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:46.310697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:46.442563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289cf76-da66-46da-b41a-89aa07ee88ae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:46.481479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:46.483524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.484181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.485131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.492915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:46.492915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:46.492915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:46.503288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 243/486] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:46.510019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:46.533120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:46.542644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:46.553836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6095a4e-b328-4168-8b42-593f4c583234 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:46.614739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:46.615393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.615677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.615953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.626604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:46.631537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:46.632408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:46.633220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 244/487] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:46.640210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:46.676564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ae26d-8f11-41ce-83e8-b2ae75f5c9c8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:46.716239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:46.717305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.718786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.723807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.740451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:46.741868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-68a80865-f143-44de-a260-bc806c13ad96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:46.758655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:46.771843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 244/488] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc4f8-7a4a-4c35-8f67-ab9763ac6f6a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc4f8-7a4a-4c35-8f67-ab9763ac6f6a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bc4f8-7a4a-4c35-8f67-ab9763ac6f6a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.772931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 245/489] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:46.773532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc4f8-7a4a-4c35-8f67-ab9763ac6f6a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:46.816034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a0c4b-99bb-43c1-a668-6ab82162e94f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:46.842503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:46.863483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:46.864634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.865045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.865419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.866551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:46.866954 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:46.869176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211350a-b769-4221-a277-bd4b08190605 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:46.881930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 245/490] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:46.883940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.884966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.885623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.888602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bc4f8-7a4a-4c35-8f67-ab9763ac6f6a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:46.909747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:46.911055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:46.915135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:46.927286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:46.928219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:46.928671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:46.929176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:46.930038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:46.930517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:46.932395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:46.946105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 246/491] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:46.947877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.000856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 246/492] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:47.001347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.080299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9c16-dbf6-48cf-a3ab-48d742707de5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.108020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.119112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.119846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.120184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.120516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.125212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc97db-730c-417a-a80e-de44ea32eba9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.131271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.132803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:47.148047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:47.149222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:47.151055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:47.151055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:47.151055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:47.151055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:47.151055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 247/493] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:47.151389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.168918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.169559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.169843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.170120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.177858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.179297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.182463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-08d606ad-2e23-498e-802c-186fc23b5d10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:47.193477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:47.194871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:47.195920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 247/494] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:20:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:47.196470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5206a0-af26-4eea-828b-7004fd643bb1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.196470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5206a0-af26-4eea-828b-7004fd643bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.197410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5206a0-af26-4eea-828b-7004fd643bb1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.201433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 248/495] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:47.201433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5206a0-af26-4eea-828b-7004fd643bb1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.262221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe083-99fc-46c2-855b-66cc2e345a01 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.297393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.298035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.298316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.298589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.309215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:47.311552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5206a0-af26-4eea-828b-7004fd643bb1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:47.314564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:47.315431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:47.316219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 248/496] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:47.316942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.351570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.352479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.352972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.353390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.354322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:47.354772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.355872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.357125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c80a-c93a-4400-85c8-96652042b148 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.370218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 249/497] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:47.371662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.372109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.372390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.391281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:47.392485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:47.427003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68114703-c4d4-437e-81b2-94b9bceca3f1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.456009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.464434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.472252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.472252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.472252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.472252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:47.472252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.472649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 250/498] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:47.472649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.472823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.512136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 249/499] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:47.513314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.581246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be58f2-043f-4e03-963e-1132a6750851 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.603422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.609992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1bab3-46ee-40cb-b1b5-3ad2127c2e9b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.614444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.615064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.615346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.615622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.616333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:47.622924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.622924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a07ffa-a2de-4c45-9032-a0b9878ea9c2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.626708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 251/500] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:47.627709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ecb2-4432-4e03-9385-f4bee156ed7c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.628000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ecb2-4432-4e03-9385-f4bee156ed7c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.628283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ecb2-4432-4e03-9385-f4bee156ed7c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.629689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 252/501] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:47.631880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ecb2-4432-4e03-9385-f4bee156ed7c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.644671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.645428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.645775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.646110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.653654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.655092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:47.667803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:47.668755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:47.669648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 250/502] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:47.670193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.687020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.734634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ecb2-4432-4e03-9385-f4bee156ed7c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.768162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.768733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.769029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.769131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb14a4-3704-450c-9fc8-9e520483d75e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.769300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.779421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:47.785047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:47.786102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:47.786935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 253/503] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:47.787604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:47.805928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.807196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.807544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.807814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.830880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.874536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.876151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.884621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae28f4-f721-4d56-9df0-8fc94f6e4581 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:47.897737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:47.919148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:47.919783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.920078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.920357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.930629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:47.932140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3f923c63-1633-4b34-85b2-86fee84a6315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:47.946542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:47.947547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:47.948395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:47.948395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:47.948395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:47.948395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:47.952336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 254/504] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:47.953627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:47.953915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:47.954195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:47.973460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:47.974676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:47.975073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 251/505] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:47.975923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.031056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.042119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 255/506] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:48.042962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.077797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98d846-9739-423c-91e8-a0154150799c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.111701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.112325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.112585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.112891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.113670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:48.114006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.115421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.131917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 252/507] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Jul 27 08:20:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:48.132738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.137307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.144109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bca2b-6e0c-4bf8-b066-362bc40f4764 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.178550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.179163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.179440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.179711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.180412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:48.180713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.182153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.189768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 256/508] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:48.190543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.244141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97686f4e-44ce-43f8-b59c-cd47fbf364fd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.257000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.278746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.279393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.279681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.279962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.280648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:48.280984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.282405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.288267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ae162-3264-457d-89b1-f84eb9c2b22f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.294242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 253/509] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:48.294242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.322156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22454093-6869-4482-b0a2-30065940215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.323164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22454093-6869-4482-b0a2-30065940215a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.323513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22454093-6869-4482-b0a2-30065940215a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.323856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22454093-6869-4482-b0a2-30065940215a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.334152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22454093-6869-4482-b0a2-30065940215a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.335573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22454093-6869-4482-b0a2-30065940215a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-22454093-6869-4482-b0a2-30065940215a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:48.350312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:48.351161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:48.352003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:48.352003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:48.352003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:48.352003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:48.352003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 257/510] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:48.352498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22454093-6869-4482-b0a2-30065940215a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.363267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.396871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6338c-f5f3-4f06-975a-bca0bf95f1a4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.430080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.430711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.431014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.431311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.441779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.443210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.451946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22454093-6869-4482-b0a2-30065940215a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:48.458061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:48.458912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:48.459751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:48.459751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:48.459751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:48.459751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:48.459751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 254/511] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:48.460006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.486784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.487402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.487689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.487970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.489685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.558374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.559761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.567172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894daa1-46e9-461e-a14d-0c68aa338d24 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.569086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.601141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.601865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.602232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.602513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.612343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.613827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:48.628480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:48.629349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:48.630183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:48.630183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:48.630183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:48.630183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:48.630183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 255/512] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:48.630812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.661953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 258/513] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:48.662788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.712430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.734554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf26b0-cf34-478d-88cf-9c55cd4d5fa2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.761601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c14c-cbcf-4bad-9df7-983c430f560e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.769001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.769633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.769912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.770182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.771116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.777954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.779421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:48.791004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:48.791944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:48.793211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 256/514] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:48.793775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.798105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.798729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.799015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.799295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.799985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:48.800295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.801711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.814477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 259/515] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:48.815210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.895390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b957-80b1-4668-855c-02904dc4b4b0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.913421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482b9d3-e3df-47cb-b8de-88fdfe76e2ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:48.928240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.928882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.929168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.929442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.930135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:48.930441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.932578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.934837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:48.944342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 257/516] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:48.951055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.951202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:48.951202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:48.951202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:48.951202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:48.951578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:48.951578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:48.951578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:48.962884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 260/517] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:48.963686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:48.992374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.046451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a231-61bc-41f6-8090-531270bb4470 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.066652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69873f-8beb-4434-ba50-41c96935bde1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.079684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.080319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.080599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.080898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.090853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.092300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.100583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.101231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.101515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.101788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.102575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:49.103433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.104869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:49.107008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:49.107830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:49.108670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:49.108670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:49.108670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:49.108670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:49.108670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 258/518] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:49.108974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.142426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 261/519] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Jul 27 08:20:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:49.143254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.163779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.215427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfeb65-941d-451c-a8e4-97aca6327e1a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.226960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.241855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fde5c-6d95-437a-b17e-c4536db7f1d7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.250510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.251144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.251426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.251708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.258330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.259886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:49.271965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:49.273028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 259/520] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:49.273996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.279993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.280617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.280937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.281220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.281894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.283341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.371545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11319ad-892b-4ae0-a73d-6aac908efa3b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.380091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.395930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 262/521] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:20:49 2022] POST /identity/v3/users => generated 247 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:20:49.401401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.406801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.407460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.407743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.408017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.417432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.418985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:49.433032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:49.434194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:49.435095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 260/522] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:49.435669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.550052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719631e1-68ca-4efc-a933-f8908d3ac26e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.566177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f4f59-d437-4dea-9317-d1eced03e5e7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.594912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.595541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.595825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.596089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.596861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:49.597174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.598550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.605695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.606320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.606607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.606885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.610387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 263/523] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:49.611218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.615679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.646202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.679996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.682366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.719828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f856e9-8195-4b66-a3b7-addf2baedec7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.759637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.760263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.760545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.761196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.761600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:49.761908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.763639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.782051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 264/524] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:49.783155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.795331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 261/525] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:49.796415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.855312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.871775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:49.898715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356626d8-7e1b-4734-9e4b-ebb2985829d2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.907060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dca01-fa78-46e2-92d6-30bde3a17bf8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:49.933690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.934318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.934601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.934878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.935670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:49.935979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.937460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.942639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:49.943278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:49.943563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:49.943838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:49.952220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:49.953704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:49.960225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 265/526] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:49.960225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:49.970641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:49.971535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:49.972392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 262/527] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:49.972880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.074424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b6c9-eefc-4632-8e58-feecb8cda41d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.075819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b067258-8831-49c6-a669-3a272f5d9cf2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.098145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:50.105338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:50.112932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.113577 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.113860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.114325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.114944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.115718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.116144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.116561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.117540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=bb119ceb349f429aacde98d2940dde47) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:50.118009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.119901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.124793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.126320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.126475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 266/528] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/role_assignments?user.id=bb119ceb349f429aacde98d2940dde47&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:50.127414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:50.155355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:50.156448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:50.157502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:50.157502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:50.157502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:50.157502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:50.157502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 263/529] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:50.157502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.264048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0994-5682-4bf1-ad88-a366206b3461 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.277876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f080f1-79a0-4420-91cf-5b6b1ad2a195 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.316657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.317436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.317729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.318050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.318333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.318440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.318602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.318965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.319351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:50.319657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.321123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.346230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 264/530] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:50.347027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.393555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:50.412047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.412047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.417114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:50.457423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc53b-d4da-4889-a6b1-96a335597ec6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.493805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.494633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.495088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.495432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.496263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:50.501589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.503157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.522806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 265/531] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:50.524052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.535870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 267/532] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:50.541759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.636056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:50.640287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531be89-16dd-4953-8dc0-8199c3a73e8b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.652969 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:50.674037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3824b4-c9f1-4177-8f1d-6e96be31cffa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.680778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.681494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.681781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.682055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.682849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=1f9429e0cfd94f279a255fff511a4737) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:50.683159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.685177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.697425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 266/533] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/role_assignments?user.id=1f9429e0cfd94f279a255fff511a4737&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:50.697425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.751851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.753007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.753506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.754006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.771590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.773394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:50.795994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:50.801292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:50.802120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:50.804777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 268/534] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:50.810900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.823569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f220084-64fb-40a0-ad48-c449402cb111 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:50.865792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:50.867341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:50.867845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:50.868279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:50.882820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:50.885851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:50.909672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:50.910594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:50.911454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:50.911454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:50.911454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:50.911454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:50.913559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 267/535] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:50.920112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:50.943756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:51.035581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05942c2-7f22-425f-ace9-25183df9b417 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.049580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e712-37ee-4106-9da9-7065ee091451 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.089787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.090829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.091658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.092153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.093082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:51.093604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:51.095166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:51.109950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 268/536] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:51.114374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.114832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.115026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.115306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.116080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:51.116396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:51.116866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:51.117984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:51.144456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 269/537] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:51.150403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:51.158863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:51.208901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:51.250663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae1fc-cac6-4873-b374-56332fe868ed None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.306160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03efbd7-2081-434d-916e-b2a9c7d3ef25 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.347826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.349222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.350097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.351031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.351575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.352056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.353070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.353322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.354487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=9f29724574eb4370a0f60e2a612401cc) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:51.355749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:51.357740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:51.365434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 270/538] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:51 2022] GET /identity/v3/role_assignments?user.id=9f29724574eb4370a0f60e2a612401cc&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:51.377852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:51.379367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-17d57f00-617b-48a6-b639-b1290c9f39f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:51.408331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:51.409299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:51.410173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:51.416953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 269/539] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:51.424131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:51.449108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e491-9d21-4734-912d-7fc4c884bcf8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.449497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e491-9d21-4734-912d-7fc4c884bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.449785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e491-9d21-4734-912d-7fc4c884bcf8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.451621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 270/540] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:51.457138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.457603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.457951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.489139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:51.490452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:51.514087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:51.557053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea367-0597-446c-a4d5-29ac25839707 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.630353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.630986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.631275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.631553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.632305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:51.632614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:51.634168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:51.646359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 271/541] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:51.656107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 271/542] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:51.661845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:51.671547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:51.784708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:51.864036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e976-c3a6-45a6-bed4-2a08d6b5c6ce None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.867935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29421da6-6754-4bd4-a27d-a65535263e62 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:51.897771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:51.914186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.914934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.915960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.916431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.937820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:51.940889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:51.941581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:51.941933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:51.942276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:51.943019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:51.944046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:51.945047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:51.945792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=aefebccee9e74e91a48485fa6f074698) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:51.945881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 272/543] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:51.945959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:51.947807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:51.952667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:51.954091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 272/544] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:51 2022] GET /identity/v3/role_assignments?user.id=aefebccee9e74e91a48485fa6f074698&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:52.133362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91f126-8e3d-4bc6-b615-f6c7824a08e4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:52.183172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:52.183825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:52.184110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:52.184384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:52.185160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:52.185471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:52.186846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b797540-24f9-43e8-b251-6a843f1d857b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:52.200379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 273/545] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:52.206138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:52.350873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded97b1d-8a3a-41cd-b69f-13b1977fb4d0 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:52.389889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966863-5b25-4e46-8bf1-c5af18774bfc None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:52.390175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966863-5b25-4e46-8bf1-c5af18774bfc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:52.390368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966863-5b25-4e46-8bf1-c5af18774bfc None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:52.392250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:52.392430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 274/546] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:52.397452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:52.397741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:52.398023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:52.404481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:52.405153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:52.405432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:52.405705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:52.425635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:52.427115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:52.428799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:52.430004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:52.455445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:52.457479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:52.459553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:52.459553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:52.459553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:52.459553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:52.459553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 273/547] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:52.466016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:52.526265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:52.562854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 275/548] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:20:52.598953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:52.635077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f99b-4e4f-4db1-b9e6-fc69c1ecae29 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:52.697545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:52.699532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:52.700229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:52.701823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:52.702755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:52.703065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:52.704439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:52.720600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 274/549] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:52.725906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:52.776828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf1e8-a672-49c7-a530-162a63c647aa None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:52.819811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:52.868872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:52.870025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:52.870513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:52.871019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:52.909505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:52.914876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:52.916389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:52.917227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:52.919960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 276/550] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:52.925638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:52.933876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ad3d-354d-4184-bcdc-502c4278f3a4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.007965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.007965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.007965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.007965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.017089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:53.022001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:53.023714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:53.043872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:20:53.046001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:53.048952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 275/551] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:53.058453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:53.249553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b75ebc-bb51-4687-bbdf-05d0cdebcc6e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.252690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:53.308184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.309149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.309439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.309716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.310521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:53.310829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:53.312282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138502b-b35a-4d68-bbc4-74c922a2590f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:53.323745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89183d-6fd6-4d27-a8f1-1e49f198afc0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.346615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 276/552] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Jul 27 08:20:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:53.347971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289799d-b8a0-4e74-8bd6-b68ea71dbb6b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.348262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289799d-b8a0-4e74-8bd6-b68ea71dbb6b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.348540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289799d-b8a0-4e74-8bd6-b68ea71dbb6b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.358004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 277/553] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:53.360051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289799d-b8a0-4e74-8bd6-b68ea71dbb6b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:53.399138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.400433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.400716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.401013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.401743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:53.402045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:53.404533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d913-53ba-4d25-bba7-8543f67f61a3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:53.420454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 277/554] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:53.422912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.423201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.423478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.480067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:53.482068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:53.531946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289799d-b8a0-4e74-8bd6-b68ea71dbb6b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.559229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 278/555] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:53.560016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:53.573472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b35930-bda0-49a6-ad2c-e18f7296c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.574392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35930-bda0-49a6-ad2c-e18f7296c41a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.574906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35930-bda0-49a6-ad2c-e18f7296c41a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.575388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35930-bda0-49a6-ad2c-e18f7296c41a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.603804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:53.606463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:53.652246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35930-bda0-49a6-ad2c-e18f7296c41a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:53.654160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35930-bda0-49a6-ad2c-e18f7296c41a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:53.677462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99279d-d3f7-45b7-81bc-fca87015606c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.715937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.716539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.716868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.717212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.728222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:53.729999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:53.745429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:53.746355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:53.747307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:53.747307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:53.747307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:53.747307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:53.747307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 279/556] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:53.747993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:53.770311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 278/557] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:20:53.771617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeef0c-1aa4-4a8d-b4df-a50b403d533d None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.771906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeef0c-1aa4-4a8d-b4df-a50b403d533d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.772182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeef0c-1aa4-4a8d-b4df-a50b403d533d None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.776854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 279/558] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:53.776854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeef0c-1aa4-4a8d-b4df-a50b403d533d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:53.838679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:53.847923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:53.869325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d432-7cfc-4a9f-8eaf-423750a29049 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.894025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeef0c-1aa4-4a8d-b4df-a50b403d533d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:53.906003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.906639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.906916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.907188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.918144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:53.923031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:53.924495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 280/559] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:53.925488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:53.942579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:53.943185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.943512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.943722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.944558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:53.944763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:53.946076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204831-b2c3-4905-bb6b-50448204128f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:53.957480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 280/560] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:53.958536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:53.958819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:53.959085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:53.979098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:53.980657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:54.045110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd65142-fdf2-40a7-a578-691ebb81c505 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.060785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 281/561] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:54.060785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.089640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.090212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.090500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.090778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.103896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.105397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.108238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.117893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:54.120678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:54.127761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:54.128876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:54.128876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:54.128876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:54.128876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:54.128876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 281/562] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:54.128876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.179894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928dc28-1259-443c-b60d-8ac4c0b07bbd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.215565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.216188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.216472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.216772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.217494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:54.217801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.219180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.227635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 282/563] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:54.228699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.233860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646ef87-57cf-4827-8c68-a669aab84ca5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.274084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.275288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.275578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.275966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.283570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.285042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:54.297455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:54.298487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:20:54.299408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:54.303188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 282/564] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:54.303910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.338018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b080d2-b8a8-499b-8e54-67e78afb10ea None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.353135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.361855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.376284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.376992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.377275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.377547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.389144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:54.394159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:54.395076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:54.395942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 283/565] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:54.396636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.414713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7bba7-c45d-4315-9e35-38f5c375fbeb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.449796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.450420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.450702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.450982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.451671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:54.451976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.453369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.465174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 283/566] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:54.465955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.512824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed59f3-5d91-4e42-ab2d-754cd8341f3a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.546155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.546795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.547076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.547353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.558614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.560139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.568082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bffaf-63ee-427d-bb89-9fc607077115 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:54.574581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:54.575695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:54.576588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:54.576588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:54.576588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:54.576588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:54.576588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 284/567] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:54.576588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.584249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.602347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.603546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.603777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.604056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.604886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:54.605197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.606416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.606703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fafa-b19f-4959-9e75-f9175648f2ff None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.624813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 284/568] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:54.626228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9d8a1-42c3-4bf1-928e-76b7e72e7ff1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.626521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9d8a1-42c3-4bf1-928e-76b7e72e7ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.626795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9d8a1-42c3-4bf1-928e-76b7e72e7ff1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.628132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 285/569] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:54.628695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9d8a1-42c3-4bf1-928e-76b7e72e7ff1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.686057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5d6c-9239-401c-b34c-b8b857f50edd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.719174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.719866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.726584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.726584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.726584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:54.726584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.726584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.729377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9d8a1-42c3-4bf1-928e-76b7e72e7ff1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.731332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 285/570] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:54.732216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.768599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.769264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.769549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.769830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.777203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.778636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:54.791019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:54.792037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 286/571] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:54.792956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.824651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.829435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:54.839338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d2af-2615-45fe-9ea9-72588bffddfc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.872603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.873176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.873460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.873736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.874512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:54.874816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.876188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def1de1-4a5c-404c-922d-03f89ffb907c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.888473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 286/572] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:54.889762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.890059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.890334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.893927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b27c-f0fc-4342-a2f3-df55a9c29174 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:54.907994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:54.909215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:54.929424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:54.930060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:54.930343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:54.930631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:54.941352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:54.942794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:54.957646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:54.958674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:54.959767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:54.959767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:54.959767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:54.959767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:54.964040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 287/573] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:54.964774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:54.976470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 287/574] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:54.977343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.049424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.058367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.064104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d97fca-18a7-483e-bdae-3f5e8e8fe849 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.080418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03edb-d5ee-44f9-bed0-445160811910 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.099207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.099848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.100136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.100417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.111015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.112451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.115460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.116074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.116353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.116624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.117403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.117709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.119852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:55.127559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:55.128553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:55.129894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:55.129894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:55.129894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:55.129894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:55.129894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 288/575] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:55.129894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.134157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 288/576] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.135072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.228466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c711f31-9257-4b10-b64b-3ba0ef77505b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.233464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69ecea-5bac-4673-9347-8e806ce6fb8b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.261434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.262075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.262360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.262904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] PATH_INFO: `/v3/users/glance` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.266269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.266872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.267148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.267419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.268089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.268387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.269769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.270196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.271634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.272047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.273447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.281360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 289/577] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.282146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:55.283312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:55.286703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 289/578] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:55.287620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.383448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27bb30-13e9-41a6-9edb-6d9ece21d7fb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.387181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc08d0-1185-4586-9842-023868ee0fed None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.417429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.418060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.418340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.418611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.420679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.421312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.421594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.421870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.422553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.422861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.424225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.428270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:55.433425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:55.434523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 290/579] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:55.435565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.438968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 290/580] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.440105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.490633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.495686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.534404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7217-36b7-4d5c-a99d-2f40d6a72f25 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.537127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05920-f868-41cc-b8a7-19d0d0115db5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.569736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.570351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.570633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.570905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.572273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=d4612a994b4a481bac7f122c9ebe8405) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.572585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.572682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.573348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.573631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.573908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.574049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.579461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 291/581] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/role_assignments?user.id=d4612a994b4a481bac7f122c9ebe8405&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.580249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.585822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.588083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:55.601108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:55.602218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 291/582] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:55.603659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.704373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1657d6-9b68-4bb3-aab5-54d67e48f5ef None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.715994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b96e-cadb-4ba6-a9e2-0407412d9ded None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.726687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.740236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.742357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.743674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.743674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.743674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.744299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.744608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.746088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.758616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.760303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.760794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.761069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.761861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.762174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.763790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.769091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 292/583] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.769091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.779070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 292/584] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.779925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.870693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ffa7f-0f43-4c4a-964f-3cb4948434bc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.887754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2585a-e1cf-4691-9d24-77e069e2fbd1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:55.905469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.906111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.906392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.906663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.913723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.915255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.923051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:55.923896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:55.924345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:55.924796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:55.925708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:55.926164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:55.927093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:55.928179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:20:55.929358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:55.930749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:55.933105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 293/585] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:55.933946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.944009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 293/586] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:55.945170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:55.978974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:55.994630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.042320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b130e65-db82-4794-9a63-f9ff2d3af551 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.054291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485238-f137-4c13-a99f-f4ae447af334 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.077033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.077675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.077961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.078234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.089539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.089982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.090619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.090900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.091000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.091170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.101620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.103814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:56.107044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:56.107893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:56.109186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:56.109186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:56.109186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:56.109186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:56.109186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 294/587] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:56.109472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:56.124470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:56.125434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:56.126307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:56.126307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:56.126307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:56.126307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:56.126307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 294/588] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:56.126585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.204351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.215527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f76bd-a4e5-4ea8-92e1-293c344ad947 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.220584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.230769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf149c-ed9a-406c-a6ee-d85e50aa0257 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.250330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.250947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.251229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.251497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.252274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:56.252583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.254049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.267422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.268107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.268393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.268755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/bb119ceb349f429aacde98d2940dde47/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.279640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 295/589] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:56.279640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.285209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=bb119ceb349f429aacde98d2940dde47, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.286660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.362251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 295/590] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:56 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/bb119ceb349f429aacde98d2940dde47/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:56.362985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.392359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42fa4-d413-4700-a9ce-fcdef1862877 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.434808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.435443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.435727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.436004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.436759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:56.437349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.438574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.457468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 296/591] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:56.458246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.475219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.512822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f8ef-18ad-471b-84f2-0fb935c62afd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.562379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.563010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.563290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.563562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.564255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:56.564557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.566495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.584179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 296/592] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:56.586387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.591776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.602009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce6097-05e1-4a66-9374-20406d75f656 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.639767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.640406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.640683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.640981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.652324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.653910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:56.670282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:56.671187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:56.672072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:56.672072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:56.672072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:56.672072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:56.672072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 297/593] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:56.673113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.732760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c525d43-322c-4786-a3a4-0173cbe7eb95 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.740564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.779190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.780069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.780502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.781086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.783476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2fa1e-454e-4873-9042-98beed55dec6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.788790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.790767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:56.804164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:56.807648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 297/594] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:56.808536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.820056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.820750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.821034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.822024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.830231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.831760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:56.843306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:56.844244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:20:56.846302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:56.850246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 298/595] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:56.850246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.877955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.921527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13f4d1-07de-4bfc-b98a-9ab446ddd7a0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.954853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426c7d-1fbd-486f-a2ab-a8b5f5a7a3e9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:56.959534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.960165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.960452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.960752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.961452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:56.962530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.963932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:56.975561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:56.979250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 298/596] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:56.980108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:56.990644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:56.991307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:56.991589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:56.991860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:56.992596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:56.992925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:56.994626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.007213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 299/597] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:57.008088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.090521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997e94e-f32e-49ff-86e5-c6d330d9000b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.110903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef85c0-3344-4600-af90-413541f1f7bb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.115835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:57.128588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.129509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.129938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.130359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.131296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:57.134937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.134937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.147306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.147945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.148222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.148487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.156007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 299/598] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Jul 27 08:20:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:57.157059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.160343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.161891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:57.175165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:57.176267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:57.177293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 300/599] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:57.177837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.221409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:57.273616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f3b6-caac-499e-80ae-1c2d55ea62ce None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.281903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e33c-a8cb-4682-bba7-79ea953f2099 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.312905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.314037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.314546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.315071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/1f9429e0cfd94f279a255fff511a4737/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.316697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.317422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.317765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.318191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.329909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.331876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.332426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=1f9429e0cfd94f279a255fff511a4737, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.334208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:57.347583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:57.348532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:57.349440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:57.349440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:57.349440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:57.349440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:57.349440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 301/600] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:57.349440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.414181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 300/601] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:57 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/1f9429e0cfd94f279a255fff511a4737/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:57.415848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.453805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:57.463744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ade2-006b-42df-936d-cc955003ac90 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.466259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:57.505059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.505846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.506437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.507227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.511875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:57.512745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.514511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.534783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 302/602] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:57.535232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.594329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c62d8-b103-4149-a83b-e82c999aa799 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.661645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.662225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.663566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.663566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.663900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:57.664139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.666204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2209-0c4e-459f-b387-d90f659e0252 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.676995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532893d-9f64-4cdf-8a9f-4f6a199eee37 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.684327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 301/603] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:57.685841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84116150-1b6f-42ec-8bd5-bf752141621f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.686144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84116150-1b6f-42ec-8bd5-bf752141621f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.687150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84116150-1b6f-42ec-8bd5-bf752141621f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.693054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 302/604] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:57.693815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84116150-1b6f-42ec-8bd5-bf752141621f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:57.720711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9591c5-61d1-41a6-9a5e-7b5e7db1cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.721423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9591c5-61d1-41a6-9a5e-7b5e7db1cc21 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.721699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9591c5-61d1-41a6-9a5e-7b5e7db1cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.722632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9591c5-61d1-41a6-9a5e-7b5e7db1cc21 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/9f29724574eb4370a0f60e2a612401cc/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.738768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9591c5-61d1-41a6-9a5e-7b5e7db1cc21 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=9f29724574eb4370a0f60e2a612401cc, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.740437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9591c5-61d1-41a6-9a5e-7b5e7db1cc21 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.805253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:57.815899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84116150-1b6f-42ec-8bd5-bf752141621f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:57.834526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 303/605] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:57 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/9f29724574eb4370a0f60e2a612401cc/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:20:57.837227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.837595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.837874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.855721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:57.857748 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:57.866491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:57.866491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:57.866491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:57.869162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:57.870932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:57.873865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:57.875696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:57.902428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:57.903385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:57.904278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:57.908243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 303/606] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:57.913999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:58.014187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 304/607] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:20:58.037266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:58.075468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419fc7a-7a3d-4556-bb42-058d3d90e7d2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:58.142472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:58.143492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.145074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.145627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.147126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:58.147778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:58.152753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:58.172751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 304/608] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:58.178546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:58.197313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:58.214456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90292ef-54f5-4309-bd41-52dd5ad2f05a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:58.265469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:58.277268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:58.278244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.278703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.279401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.300904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:58.308320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:58.309375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:58.310182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:58.313245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 305/609] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:58.321911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:58.347677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52ccca-0aae-42d1-ada3-ead8c786d1ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:58.391319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:58.392004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.392290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.392571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/aefebccee9e74e91a48485fa6f074698/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.417987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=aefebccee9e74e91a48485fa6f074698, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:58.420378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:58.476527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fb8fc-5a48-4d0c-8333-04022e832de7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:58.509255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 305/610] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:20:58 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/aefebccee9e74e91a48485fa6f074698/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:20:58.528102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:58.529081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.529567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.530018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.530928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:58.531377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:58.533101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:58.544449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 306/611] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:58.552694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:58.647155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:58.708476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9a036-4950-40bd-8842-c9dfec1a78e6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:58.749036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:58.749763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.750052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.750334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.763734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:58.765467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8264c679-f3c5-4b97-a975-4008833ddbe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:58.783676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:58.784628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:58.785537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:58.785537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:58.785537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:58.785537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:58.785537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 306/612] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:58.790908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:58.812221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368053d4-72bc-4516-9683-fb6c5d809e1d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.812822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368053d4-72bc-4516-9683-fb6c5d809e1d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.813307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368053d4-72bc-4516-9683-fb6c5d809e1d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.815109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 307/613] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:20:58.820635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.821742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.822260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.845108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:20:58.846772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:20:58.863470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:58.920752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1a764-8745-4c66-9bd2-d18184a6419e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:58.943564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 308/614] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 08:20:58.965948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:58.966569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:58.966847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:58.967118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:58.967802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:58.968100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:58.969491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:58.991108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 307/615] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:58.996784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.017659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.070232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:59.176105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bb643-9e34-436f-b940-9b3c0b8391c6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.214379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef3f3d-88a0-4db9-926e-76d063b8a6ad None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.240490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.241314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:59.242364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.243416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.243925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.251876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.258037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:20:59.266716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:59.267937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:59.269339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 309/616] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:20:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:59.274582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.286014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.286679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.286961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.287234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.307424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:20:59.312344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:59.314547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:59.316632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 308/617] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:59.325712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.383037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f3c0-b68e-4ffe-8115-5196455917ca None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.385457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:59.420932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.421550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.421828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.422099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.422879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:59.428750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.428750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.445353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 310/618] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:59.450979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.560547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5bb6-4a05-4247-87a9-e50876e32279 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.596189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.596859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.597141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.597415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.610950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.612388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.613628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fcc9f-3509-47ef-9f5d-a49943c6547a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:59.628781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:59.629777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:59.631328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:59.631328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:59.631328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:59.631328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:20:59.631328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 311/619] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:20:59.636153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.652199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:59.692158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.692865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.693150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.693427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.694284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:59.694471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.695878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.718117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 309/620] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:20:59.725605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.750275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8d75-c22b-4ea8-9b84-44918a4a423e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.787794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.788959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.789490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.790534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.791418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:20:59.791931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.793518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.797974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:59.807587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 312/621] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:20:59.813333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.883324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988afaf-4fd8-4289-b5df-bd9c81207a32 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.891233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:20:59.919628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.920311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.920591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.920894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.925500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e4b8-b3d6-45bd-b864-dc4ba703f391 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:20:59.932561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.934041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5543e567-e82e-4046-b7fb-23784aaee945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:20:59.948811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:59.949723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:59.950610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:20:59.950610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:20:59.950610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:20:59.950610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:20:59.954792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 310/622] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:20:59.956047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5d046-e850-4984-915d-6c2b59c9f0d5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.956332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5d046-e850-4984-915d-6c2b59c9f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.956602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5d046-e850-4984-915d-6c2b59c9f0d5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.958149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 311/623] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:20:59.958853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5d046-e850-4984-915d-6c2b59c9f0d5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:20:59.970015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:20:59.971024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:20:59.971506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:20:59.971975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:20:59.983177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:20:59.984983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-828b63d1-7efe-4fae-b077-2a07e7643d92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:20:59.997405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:20:59.998292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:20:59.999161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:00.001685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 313/624] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:00.007413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.008075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.008696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.029042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:00.030588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:00.057468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.072120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5d046-e850-4984-915d-6c2b59c9f0d5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.107664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.108287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.108568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.108887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.109576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:00.109915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.110378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 314/625] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:00.111247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.111678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.141177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 312/626] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:00.146515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.178738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.219233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee7373-75ee-45cd-98d2-17eb5769c9b3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.254214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.254889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.255180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.255454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.256217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:00.256504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.257943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.258769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f21f8-ccb6-40d3-9e89-fddd3b614049 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.269381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 315/627] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:00.270188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.298750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.299828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.300367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.300894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.309381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.310809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e9155c45-f54a-48c2-afd6-2ddf63f1e524 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:00.323274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:00.324216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 313/628] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19592a-2775-4aca-bc88-22a08b442337 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.330043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19592a-2775-4aca-bc88-22a08b442337 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.330871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19592a-2775-4aca-bc88-22a08b442337 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.330871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 314/629] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:00.330871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19592a-2775-4aca-bc88-22a08b442337 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.341193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.386990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44c574-ecbe-4ca6-b6c6-6e1efb778a57 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.412634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.424570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.425293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.425591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.425831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.435981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19592a-2775-4aca-bc88-22a08b442337 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.437574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:00.443139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:00.444256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 316/630] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:00.445132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.478510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22917b05-4baa-4fa9-b5dc-7b0f6e80012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.479176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22917b05-4baa-4fa9-b5dc-7b0f6e80012b None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.479454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22917b05-4baa-4fa9-b5dc-7b0f6e80012b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.479727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22917b05-4baa-4fa9-b5dc-7b0f6e80012b None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/d4612a994b4a481bac7f122c9ebe8405/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.495763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22917b05-4baa-4fa9-b5dc-7b0f6e80012b None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=d4612a994b4a481bac7f122c9ebe8405, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.497242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22917b05-4baa-4fa9-b5dc-7b0f6e80012b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.557794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e340-7ad3-47bb-afd8-b1adbc6c240c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.578144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 315/631] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:00 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/d4612a994b4a481bac7f122c9ebe8405/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:21:00.580063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.580812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.581228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.594542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.595236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.595516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.595789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.596658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:00.597040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.598777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.606082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:00.607887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:00.621377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 317/632] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:00.622257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.670203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.690009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.712871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 316/633] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:00.713923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.752141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1879cd-7a66-4d2f-8a4d-a7e04e3a7606 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.794042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.794770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.795055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.795332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.796351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:00.796351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.797774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.806794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 318/634] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:00.807683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:00.846554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5267c-935a-43e2-b943-03c37f50a910 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.882941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.883990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.884475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.884951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.932625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa164291-8866-4530-b7c1-d3903da260f5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:00.934376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.950111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:00.963364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:00.965199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:00.972229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:00.972965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:00.973256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:00.977938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:00.984642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:00.990556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:00.991469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 319/635] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:00.992297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.080647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 317/636] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:21:01.081810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.103940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11aa0-4eeb-4b04-bd4c-8511c51f806b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.138396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.139044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.139331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.139616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.150953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.152405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1281e57c-5848-4b3c-8b63-d6cdfe56ca75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:01.167060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:01.168168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:01.169113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:01.169113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:01.169113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:01.169113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:01.169113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 320/637] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:01.169928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954c3b-f125-465d-8a99-72323013e5b6 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.170216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954c3b-f125-465d-8a99-72323013e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.170505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954c3b-f125-465d-8a99-72323013e5b6 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.175983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 321/638] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:01.176802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954c3b-f125-465d-8a99-72323013e5b6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.184154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.192614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.199190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2210-285c-44f0-b930-0e066a36b949 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.236686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.237395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.237680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.237957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.238669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:01.238978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.240506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.249384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 318/639] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:01.254838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.281526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954c3b-f125-465d-8a99-72323013e5b6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.315648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.316281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.316563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.316864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.327353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.328817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-eb68d98a-76f0-4cc8-9514-a25adb3888ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:01.344237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:01.345379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:01.346557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:01.346557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:01.346557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:01.346557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:01.349728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 322/640] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:01.350941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.351219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.351495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.364182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77d732-e738-44ad-aade-782e40e64b87 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.369439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:01.370625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:01.401563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.402507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.402971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.403426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.404389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:01.405016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.406422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.424491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 319/641] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:01.424491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.433452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.440150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.449732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 323/642] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:01.450552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.548880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8365a2-e94c-4374-9ee4-03e50ef1be88 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.558635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15b23a-2c0d-46ac-8220-3d08c0fa7bf5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.585618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.586251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.587138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.587484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.596410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.597043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.597346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.597610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.598264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.598365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:01.598565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.599716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.599886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.612107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 324/643] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:01.613671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:01.616874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:01.618004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:01.618938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:01.618938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:01.618938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:01.618938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:01.622499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 320/644] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:01.623343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.676073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.691935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.725876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1ade-8ab9-46c7-88e3-4c0c8b8c0b9f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.732097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b92d-4064-4c68-ad88-a02c97b677b4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.762652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.763292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.763579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.763858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.770446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.771087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.771370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.771648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.775404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.776902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.782747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:01.788339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:01.789451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:01.790678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:01.791334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:01.792711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:21:01.795112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:01.796564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 321/645] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:01.796746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 325/646] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:01.796895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.797049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.900067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ba4ba-09ef-472e-9e45-fd290c996dfe None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.900405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100335f-366d-48c2-b77f-4ecd949f40e9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:01.915719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.923037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:01.933475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.934091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.934380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.934657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.934874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:01.935344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:01.935507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:01.935657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.935804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:01.936047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:01.937046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.942733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:01.944175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:01.955189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 326/647] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:01.955189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:01.961369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:01.963105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 322/648] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:01.964016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.057963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1b0f3-07bc-45c2-ac3a-c7385f3b532b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.067723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c7ff-067b-4bca-b2b7-b9ac6586f3da None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.093129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.093747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.094030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.094303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.095083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:02.095384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.096833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.104174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.104819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.105102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.105376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.106084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:02.106389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.107737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.119197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 327/649] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:02.119197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.119490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 323/650] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:02.119490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.157238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.167731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.223012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c55d86-12d1-45ee-9e7b-b8263ab54a15 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.228578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c180bbf-8024-432b-aad9-db3fd5b5e8c0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.259847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.260462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.260760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.261046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.261787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:02.262089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.263788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.265058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.265803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.266187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.266574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.273836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.275411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.276580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 324/651] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:02.278264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:02.287220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:02.288354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 328/652] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:02.289398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.389317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.394610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686768c-50d2-45eb-9d4c-e9f12c786cbc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.396336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8d63-997f-45e9-8226-cb6e27e2d8be None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.397010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.429923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.431375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.431646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.431921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.432193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.432858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.433136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.433414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.446343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.447876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:02.463141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:02.464252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:02.465171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:02.465171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:02.465171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:02.465171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:02.465171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 329/653] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:02.465171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.515989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.517528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.582682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab5558-e584-4e23-b682-2aaf1fcef1ef None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.623670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 325/654] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:21:02.623670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.625732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.627302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.627930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.628215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.628495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.629330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=bb119ceb349f429aacde98d2940dde47) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:02.629645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.631079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.638211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 330/655] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/role_assignments?user.id=bb119ceb349f429aacde98d2940dde47&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:02.639030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.653573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.762732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b595-d9db-4239-a516-722c60861890 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.763432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d675e-19e7-49f5-ab79-5c90be255bca None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.802495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.803482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.803482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.803657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.804349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:02.804520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.804696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.805206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.806045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.806549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.806758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.807344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:02.807713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.809727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc399-847e-418e-881f-31c6048f9d22 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.821260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 331/656] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:02.821569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.828592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 326/657] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:02.830214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b83f6-32e8-406a-8f97-38d9d49873e9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.830702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b83f6-32e8-406a-8f97-38d9d49873e9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.830980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b83f6-32e8-406a-8f97-38d9d49873e9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.832186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 327/658] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:02.833693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b83f6-32e8-406a-8f97-38d9d49873e9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:02.906530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.910382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:02.940210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb01913-74af-456b-8de9-6b7a0d77a961 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.950745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b83f6-32e8-406a-8f97-38d9d49873e9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:02.977992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.978639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.978921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.979393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.986761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:02.987400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:02.987684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:02.987964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:02.990042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.991669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:02.996131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:02.997719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:03.009361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:03.010270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:03.016469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:03.016469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:03.016469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:03.016469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:03.016469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 332/659] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-fdca1881-c5ac-48ca-8335-4eb357f49b31 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:03.016808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:03.018377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:21:03.019313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:03.019887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.019959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 328/660] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:03.019959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.019959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.019959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.036825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:03.038169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:03.121983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285c9f-ba22-4a15-925c-87149c231172 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.125076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 329/661] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:03.125785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.147227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.158633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.159237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.159528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.160022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.191089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.234246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.235703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.241107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0296d-6c4c-4084-a959-e3240747d569 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.277058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.277597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.277881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.278148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.278840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:03.279150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.280535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.298437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 330/662] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:03.299287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.343296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 333/663] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:21:03.344444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.370627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.412584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2606b-a460-4b66-ac82-14826ec8de69 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.428358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.449775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe168-3e62-477c-8714-72ecfda32a71 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.449983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.450450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.450733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.451082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.451844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:03.452840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.453614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.472525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 331/664] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:03.473482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.490296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.490959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.491237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.491510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.504664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:03.510575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:03.511516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:03.512616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:03.513841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 334/665] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:03.514539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.592579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1a076-7367-4abd-8e89-c56798359fd8 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.604267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.622280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22ad9-df7d-4c9d-b29b-1a1c2a2b15c9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.628805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.629879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.630167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.630453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.637725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.639172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:03.651087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:03.651961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 332/666] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:03.653358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.663802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.665208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.665493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.665773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.675970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.677463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.685995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:03.692822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:03.699250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:03.700355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:03.700355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:03.700355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:03.700355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:03.700355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 335/667] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:03.700355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.766432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a8ac9-ac17-44ac-8b22-d3815901053a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.801729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.802377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.802660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.802983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.806191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332a1c-520c-41fb-92d0-9b9faf4d037d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.842851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:03.843478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:03.843876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:03.844287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:03.845167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:03.845532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.847056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.848947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.857930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 336/668] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:03.866913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:03.877838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:03.879331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:03.910100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:03.963545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71686f5-25ae-4877-b576-129969da8727 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:03.989808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 333/669] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:21:03.989808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.002472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.003165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.003527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.003810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.004564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:04.004905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.006325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.023662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 337/670] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:04.023662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.085642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.101271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4e5f-8ca9-40f8-b6ab-bbc939e61a99 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.129853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.134005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9a191-0fcb-4cf8-a010-2ea92ba5d82d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.139001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.142395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.142395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.142395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.142395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:04.142395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.142742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.154846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 334/671] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:04.156434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.171965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.172600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.172909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.173180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.184254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.185740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:04.200549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:04.201626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:04.202747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:04.202747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:04.202747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:04.202747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:04.202747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 338/672] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:04.203021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.269239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865326e-bfb9-4d4f-a155-172eb5777c96 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.304863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.306194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.306474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.306749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.315564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab8bfe-a330-4d76-bb3e-c1d83e4b464f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.318440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.319970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.325489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:04.334940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:04.338281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:04.339152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:04.339152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:04.339152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:04.339152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:04.339152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 335/673] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:04.339152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.357457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.357942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.358225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.358567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.359308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=1f9429e0cfd94f279a255fff511a4737) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:04.359798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.361046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.367051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 339/674] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/role_assignments?user.id=1f9429e0cfd94f279a255fff511a4737&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:04.375893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.387444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.472513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c19f-d5c4-432f-825b-7aee8ef15e09 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.518716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3834f-67f1-43d3-864d-4c9e2e28c977 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.526018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.526880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.527852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.528281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.536356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.538565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:04.551815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:04.552770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:04.553661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 336/675] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:04.554138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.574230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.574853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.575130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.575398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.576085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:04.576385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.577834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.599364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 340/676] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:04.599364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.637892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.684561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d063-7585-4153-b7e5-4a2aa508c689 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.691705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.720752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.721452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.721777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.722014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.722753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:04.723002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.724492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.725387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9e850-27d0-4ccd-b78c-b5bfc56da6b0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.744762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 337/677] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:04.744762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.767841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.768707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.769017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.769288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.770033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:04.770337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.771743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.788859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 341/678] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:04.788859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.855279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6835-bcd0-41b3-a789-a5b2e6a142da None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.891104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.891602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.892156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.892423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.892696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.900331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.901527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d6cdf-af3d-42e0-af13-f0147cf23186 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:04.901813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3b31b399-4b34-4a66-807f-325f614b1eaa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:04.914089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:04.915219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:04.916153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 338/679] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:04.916779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012868e2-6690-4434-862a-b19801794ab2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.917367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012868e2-6690-4434-862a-b19801794ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.917367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012868e2-6690-4434-862a-b19801794ab2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.922793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 339/680] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:04.922793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012868e2-6690-4434-862a-b19801794ab2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:04.944951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:04.945154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:04.946468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:04.946760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:04.947107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:04.954445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:04.955926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:04.970170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:04.971098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:04.972000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 342/681] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:04.972562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.035176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012868e2-6690-4434-862a-b19801794ab2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.069719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.070337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.070744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.071545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.072330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=9f29724574eb4370a0f60e2a612401cc) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:05.072642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.074101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d62cb-b549-433c-b5fb-ea37f30f8703 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.079970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 340/682] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/role_assignments?user.id=9f29724574eb4370a0f60e2a612401cc&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:05.081108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.081393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.081669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.087942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047d52-655f-4c17-b586-b18a9469cfe2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.101108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:05.101834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:05.143415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.145384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.145946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.146427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.147566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:05.148133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.150672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.177433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 343/683] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Jul 27 08:21:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:05.178378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.191833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 341/684] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:05.192781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:05.194234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.217289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:05.310892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb52fe-320f-4143-ac8f-d49baba48c7a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.327175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf8eb-060d-4701-99e8-f295a2102663 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.354454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.355343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.356057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.356475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.357423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:05.357979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.360094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.366201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.366941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.367223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.368060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.375904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 344/685] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:05.376760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.454440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.455824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.463164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:05.474251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:05.504913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a583-8278-4181-a4d5-bc7f5867e48f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.551165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.551811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.552091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.552364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.566361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:05.571096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 342/686] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:21:05.572093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:05.572451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:05.573392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:05.574237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:05.576817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 345/687] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:05.577708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.683092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa2be8-3381-496f-912d-3f612c4c92ee None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.709865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490eb8c-e1b9-4683-a725-d04c10e67276 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.714088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:05.721154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.721986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.724926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.724926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.731828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:05.733477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.735052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:05.751058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:05.755032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:05.755970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:05.755970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:05.755970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:05.755970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:05.756187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.756288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 346/688] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:05.756370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.756370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.756370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.756558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.756627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=aefebccee9e74e91a48485fa6f074698) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:05.756627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.756627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.767557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 343/689] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/role_assignments?user.id=aefebccee9e74e91a48485fa6f074698&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:05.768375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.869048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d2dc-f139-46d0-9aaf-e73f43028d36 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.901670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b226-e605-4c99-bc82-c2a11d09937e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:05.933517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.934803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.935289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.935804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.936806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:05.937294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.940373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:05.957451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 347/690] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:05.965304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:05.984682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:05.985349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:05.985636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:05.985916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:05.986626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:05.986939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:05.988346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.012840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 344/691] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:06.020057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:06.031245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:06.068350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:06.090788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c10e-3b2c-49bc-8264-c8618d2b00de None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.140877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9f3a-5e00-4082-ab80-05042b67d80e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.147805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.148461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.149286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.149564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.161552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.163159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:06.180912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:06.181939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:06.182827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:06.182827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:06.182827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:06.182827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:06.182827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 348/692] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:06.185448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.186101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.186382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.186651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.188477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:06.202576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.204716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:06.222844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:06.223747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:06.224636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 345/693] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:06.230719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:06.301352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:06.303994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa25ba-eff9-4e06-8bc5-68ba45942165 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.343475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.344241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.344594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.344965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.345798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:06.346169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.348035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.375244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 349/694] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:06.389562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:06.391332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:06.396750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de11e-f309-4c70-bb0b-2587efde584e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.429781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.430626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.431052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.431330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.432076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:06.432394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.436750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.447229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 346/695] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:06.452986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:06.563166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc98b9-68e0-4eba-a679-7094d3ad8e9d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.600208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.600853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.601133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.601411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.603255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=d4612a994b4a481bac7f122c9ebe8405) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:06.603649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.605124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b157f-4e7e-4560-86f8-7d0c80945774 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.612282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 347/696] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/role_assignments?user.id=d4612a994b4a481bac7f122c9ebe8405&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:06.658996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3764-42de-4cf2-bf62-bb7c37fb24cf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.717929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.718591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.718882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.719161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.738073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.739578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.744217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63e6a-a1a0-4eca-b9e7-c9012e258d81 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.744499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63e6a-a1a0-4eca-b9e7-c9012e258d81 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.744810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63e6a-a1a0-4eca-b9e7-c9012e258d81 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.747061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 348/697] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:06.756206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.756620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.757014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:06.761261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:06.762870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:06.764467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:06.767712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 350/698] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:06.782665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:06.820760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:06.921803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd5848-2164-4fc3-8cea-b808c365fa4b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:06.922632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:06.923914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:06.947018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:06.957723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:06.960228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:06.960228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:06.960228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:06.960228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:06.960228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:06.962279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:06.981526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 351/699] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:06.991190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.005915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 349/700] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:21:07.042103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.087429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:07.115639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6aba3f-1b6c-4cf1-8ef8-dffa20350e8a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.153740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477e55-8320-45be-a549-fa5bbf6baeb8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.154228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:07.155100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.155613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.156100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.192326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:07.193006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.193282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.193603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.210521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:07.213255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:07.231747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:07.232503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:07.233427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:07.234334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:07.234334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:07.234334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:07.234334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:07.234334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 350/701] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:07.235841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:07.243323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.259962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:07.329871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:07.355922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 352/702] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:21:07.361534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.412528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4441f0-aeef-4cb4-a5c8-51fb3965025c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.451899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:07.452533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.452860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.453276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.453977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:07.454286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:07.455664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:07.469164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 351/703] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:07.474544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.558079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:07.574704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7e09a-aeb4-4ff3-955d-a27296330914 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.598106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3afe-32b6-4f55-941c-0f0e9bffaa0a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.619274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:07.619915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.620198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.620473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.633983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:07.635432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:07.636848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:07.637964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.638466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.638940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.639814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:07.641461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2ed7f34e-544e-4c67-95a6-5410fd188bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:07.651838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:07.652750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:07.653788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:07.653788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:07.653788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:07.653788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:07.653788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 353/704] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:07.661537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb561-b4e5-401c-a39d-85cc20342e1e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.661537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb561-b4e5-401c-a39d-85cc20342e1e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.661537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb561-b4e5-401c-a39d-85cc20342e1e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.661537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 354/705] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:07.661866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.662000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.662263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.684385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:07.685663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:07.707940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:07.724535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 352/706] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:21:07 2022] POST /identity/v3/users => generated 254 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:07.726267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.773390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 355/707] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 08:21:07.802230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:07.929592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836993e-72d4-480f-918e-a2f199c12d30 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.974098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:07.974768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:07.975135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:07.975484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:07.976635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:07.981228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:07.992321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05eb5-701d-47a8-97b9-578fe0f69bc1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:07.993038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:07.994263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:07.995143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 356/708] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Jul 27 08:21:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:08.002688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.025094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:08.033802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:08.042503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.042926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.043204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.043482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.044466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:08.044797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.046464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.064028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 353/709] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:08.071321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.129313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0b51-c4b7-4bf1-97d4-4e8c092ee6e8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:08.166690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.167649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.168081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.168575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.169447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:08.169976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.171538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.176815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 357/710] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Jul 27 08:21:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:08.183888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.197024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b9f8-60dd-4905-b2e4-5015aff6da69 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:08.244536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.245603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.246061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.247059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.259402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.261806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:08.275252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:08.276190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:08.277142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 354/711] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:08.281917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.300092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:08.329636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:08.331932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554063-8626-411f-8f94-b3eb28c4353f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:08.370150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.371159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.371639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.372113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.373088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:08.373587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.375360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.381839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 358/712] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Jul 27 08:21:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:08.407215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f5c09-b007-4a2a-8497-fc6624581247 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:08.446738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.448244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.448938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.449417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.450391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:08.450920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.452624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cb898-6859-4585-9e21-6581a8980637 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.466964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 355/713] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:08.473038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.518103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451990-fb8a-4c39-aaf6-ace868e89fb7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.518392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451990-fb8a-4c39-aaf6-ace868e89fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.518671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451990-fb8a-4c39-aaf6-ace868e89fb7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.520018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 356/714] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:08.525788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.526366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.526845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.546277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:08.547836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:08.626298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 357/715] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 08:21:08.652370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.676041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494392-ed87-438e-b93c-463e2240d0e6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:08.689712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:08.723448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.723448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.723448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.723448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.723855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=bb119ceb349f429aacde98d2940dde47) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:08.723855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.723855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.734264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 359/716] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:08 2022] GET /identity/v3/role_assignments?user.id=bb119ceb349f429aacde98d2940dde47&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:08.779604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5dff-74bd-4d81-9997-76996cfe3b4a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:08.820972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:08.821635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:08.821914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:08.822192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] PATH_INFO: `/v3/services/network` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:08.822827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:08.824251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:08.835851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:08.837628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:08.838695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 358/717] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:08 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:08.845847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:08.870047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:08.984476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9719ad-7eea-48e4-a29f-dcfee4bd5ced None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:09.020300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:09.020962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:09.021246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:09.021522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:09.022198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] RBAC: Adding query filter params (name=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:09.022503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:09.024426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84705bc-f0bd-4e8c-a4b2-a39dfc486902 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:09.029294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 360/718] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:09.038072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:09.168428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:09.174505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea3f8-552f-46db-9b96-fae9c1e03abb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:09.223889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:09.224514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:09.224844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:09.225123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:09.225867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] RBAC: Adding query filter params (type=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:09.226171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:09.228190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc5e1e-ec05-4bfa-a30d-a131d091e87c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:09.237756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 359/719] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:09.258240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4e656-8206-4166-b1ff-83be54e662fd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:09.258933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4e656-8206-4166-b1ff-83be54e662fd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:09.259424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4e656-8206-4166-b1ff-83be54e662fd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:09.261269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 361/720] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:09.267412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:09.267702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:09.267985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:09.296140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:09.297420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:09.395393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 360/721] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:09.421447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4e656-8206-4166-b1ff-83be54e662fd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:09.549206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:09.584026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4e656-8206-4166-b1ff-83be54e662fd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:09.632452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:09.633161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:09.633474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:09.633702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:09.653596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:09.658546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:09.659456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:09.660300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 362/722] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:09.666210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:09.803676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:09.813403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dd634-7d28-421f-a56b-10babb1232d3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:09.863289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:09.863916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:09.864197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:09.864473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:09.865213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:09.865519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:09.866958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:09.880055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 361/723] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:09.885302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:10.036879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b3ec4-82d1-4c52-a4d3-94c3ba1701a7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:10.086431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:10.087002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:10.087280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:10.087550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:10.090471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:10.103311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:10.104793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:10.125377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:10.126313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:10.127285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:10.127285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:10.127285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:10.127285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:10.131168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 363/724] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:10.132158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:10.314350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6642b-4c83-42ac-8873-1da1f338529e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:10.356979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:10.357520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:10.357804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:10.358078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:10.358769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:10.359076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:10.360447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:10.381977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 362/725] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:10.387968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:10.551468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac403a7-b86b-4260-8dbc-813b56007368 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:10.595425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:10.596078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:10.596361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:10.596637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:10.609831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:10.611203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-409fa6a1-ea39-4195-a0b3-682684d477a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:10.626217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:10.627177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:10.628146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 364/726] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:10.633108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:10.662951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:10.676564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298afb0-60f7-4d5b-af53-2a85cceeac42 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:10.676896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298afb0-60f7-4d5b-af53-2a85cceeac42 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:10.677181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298afb0-60f7-4d5b-af53-2a85cceeac42 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:10.678528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 365/727] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:10.688790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:10.689081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:10.689357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:10.718494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:10.719698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:10.802179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:10.812758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410782aa-0f17-429f-9fae-8002a1502abd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:10.827993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 366/728] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:21:10.856006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:10.856903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:10.857330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:10.857770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:10.858723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:10.859175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:10.860843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:10.861871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:10.879747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 363/729] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Jul 27 08:21:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:10.885879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:10.962998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:10.996444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52225-31ea-4e30-a65a-d004c93f55fe None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.051849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.052718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.053194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.057107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.139318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40208469-f6c7-426d-93db-6f4645f430dc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.147111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.149669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.224949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:11.234859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.235526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.235811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.236092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.262096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 364/730] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:21:11.269050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.269487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:11.274623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:11.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:11.276762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:11.285138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 367/731] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:11.293723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.345375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:11.389466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8997b2-fe42-4ae0-bcc1-07a2c758333a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.411233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d092f9e-1ed0-4895-a100-a78fb76f373a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.423972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.424612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.424922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.425192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.436115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.437630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.450621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.451469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.451945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8cc697f6-7c09-4d1b-9b98-1d273c08a8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:11.452348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:11.453264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:11.454163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:11.454163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:11.454163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:11.454163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:11.454390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.454390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:11.454390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.455536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.458127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 365/732] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:11.459379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532abc2-5da6-44c5-b034-c96688fc8142 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.459659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532abc2-5da6-44c5-b034-c96688fc8142 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.459930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532abc2-5da6-44c5-b034-c96688fc8142 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.465539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 366/733] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:11.465539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11ba5-bf37-4dde-8b3f-02109060c5e4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.465539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11ba5-bf37-4dde-8b3f-02109060c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.465539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11ba5-bf37-4dde-8b3f-02109060c5e4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.465910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 368/734] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:11.465910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.473240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 367/735] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:11.473240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.473240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.473240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.490027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:11.490892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:11.513497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:11.560996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 368/736] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:11.562024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.592618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:11.595519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf4c7-b2e7-46d7-8c75-a7bdc2f580e5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.629841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.630458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.630739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.631016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.631693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:11.631993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.633403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d3d5b-a5de-4f5b-bd0b-c20bcce37c4a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.644490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 369/737] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:11.645627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.645917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.646188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.663735 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:11.665746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:11.665893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473d787-7d75-4023-b8ea-e5f43196ceac None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.699478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.700118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.700399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.700683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.710794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.712265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-54dc58ce-9774-4cd3-9af4-956be9652221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:11.728077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:11.729182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:11.730278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:11.730278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:11.730278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:11.730278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:11.730278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 369/738] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:11.730590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d842-d895-41d3-8f77-07fd6029c5d6 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.730675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d842-d895-41d3-8f77-07fd6029c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.730955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d842-d895-41d3-8f77-07fd6029c5d6 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.732382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 370/739] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:11.735264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 370/740] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:11.736275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.736915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d842-d895-41d3-8f77-07fd6029c5d6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.740982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:11.836544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:11.838390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d842-d895-41d3-8f77-07fd6029c5d6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.845505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb12e-cf54-4744-8a8f-866a9d71e723 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:11.871817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e3822-ea61-4da9-95b0-8e246dc28bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.872440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e3822-ea61-4da9-95b0-8e246dc28bc7 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.872744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e3822-ea61-4da9-95b0-8e246dc28bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.873027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e3822-ea61-4da9-95b0-8e246dc28bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.873772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e3822-ea61-4da9-95b0-8e246dc28bc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.875187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e3822-ea61-4da9-95b0-8e246dc28bc7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.879240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:11.879868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.880157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.880435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.887532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:11.888995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:11.900851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:11.901865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 371/741] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:11.903027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:11.995559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 371/742] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:11 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:11.997181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:11.997679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:11.998169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:11.999586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d7d5-392b-45d6-8c1d-6b881f998baf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.019001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:12.020283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:12.053098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.054158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.055354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.055805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.056563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:12.056904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.058311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.073131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 372/743] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:12.073817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.084030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:12.094588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:12.103425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 372/744] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:21:12.104306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.202800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab224-b72c-47c8-86ca-18bddaa4a030 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.212594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa178bb-a783-45bf-b28f-844f30bd5c16 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.238442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.239090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.239381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.239665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.249372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.250234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.250639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:12.250893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.251350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.252272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:12.252779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.254396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:12.255588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:12.256485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:12.257358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 373/745] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:12.258574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.272917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 373/746] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:12.274074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.335231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:12.343182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:12.377247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd2507-dbb4-48a7-81fc-8cfcb9def0d6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.381242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20674749-81e8-4b5c-ae20-b602a854be15 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.413363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.414041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.414326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.414654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.415796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.416413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.416690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.416985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.417666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.419026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.422034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.423471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:12.435512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:12.436680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:12.437708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 374/747] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:12.438304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.485924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 374/748] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:12 2022] POST /identity/v3/services => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:12.489749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.559839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69936-ed35-40d9-9993-e6c10627c54d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.590160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:12.606164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.606798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.607088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.607362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.612749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:12.612749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.612749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.624838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 375/749] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:12.625920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.650323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeada3-e052-4856-876c-f946583cd455 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.670094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:12.694195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.694819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.695153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.695433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.696416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=d4612a994b4a481bac7f122c9ebe8405) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:12.696773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.698231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.708319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 375/750] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/role_assignments?user.id=d4612a994b4a481bac7f122c9ebe8405&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:12.708319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.755933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56911c-0bc2-477c-8203-6effb7a53b24 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.821526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.822169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.822453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.822730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.823551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:12.824141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.825654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.854751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7132540-e3db-4627-9dad-b3a463e98c97 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:12.871319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 376/751] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:12.876881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.892934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:12.893585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:12.893865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:12.894136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:12.907185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:12.908655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:12.925018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:12.925952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:12.927083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:12.927083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:12.927083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:12.927083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:12.927083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 376/752] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:12.933327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:12.971151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:13.000638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:13.046991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b6627-747d-4497-bda3-d7d80ef0a123 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:13.084655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:13.085312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:13.085593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:13.086416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:13.087846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:13.088167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:13.092751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:13.104986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 377/753] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:13.113258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:13.149333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baabfe-d2de-4895-8ecd-d7116722fae5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:13.219549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:13.220183 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:13.220461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:13.220753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:13.251794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:13.275403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79dff-f81a-4f83-b394-a66c330e005d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:13.330038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:13.332634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:13.350393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:13.351433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:13.351956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:13.352431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:13.362382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:13.365564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:13.386011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:13.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:13.388180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:13.390759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 378/754] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:13.395973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:13.429119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:13.529792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 377/755] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:21:13.534898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:13.623678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf27e20-2047-4ab9-b7a4-572c1c11900c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:13.667552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:13.668533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:13.669083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:13.669582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:13.670774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:13.671342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:13.673009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:13.692499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 379/756] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:13.698543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:13.724592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:13.780475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dc322-a692-4a5d-b93d-34eeb9b1a853 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:13.879634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:13.882105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:13.883250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:13.884995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:13.917850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:13.919316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:13.926404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:13.934458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee1dd6-3a92-45d5-a2fa-400afe2e6570 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:13.954569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:13.955547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:13.956447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:13.956447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:13.956447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:13.956447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:13.960936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 378/757] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:13.962047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:13.981823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:13.982846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:13.983535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:13.985091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.006450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.009238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:14.033211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:14.034137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:14.035034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:14.035034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:14.035034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:14.035034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:14.040749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 380/758] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:14.046442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.145859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fcddb-6e89-4bf1-9a57-3532240f93a6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.170056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:14.186616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.187548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.188039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.188555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.189482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:14.190483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.192286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.206250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 379/759] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:14.212645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.250852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24e226-a081-488c-befc-6c9bb854b96a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.277025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:14.295467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.296120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.296365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.296639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.297429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:14.297732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.299108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187481-bd67-43ec-83bc-bbc2d3ec6036 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.315938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 381/760] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:14.317455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df889-49e6-4b95-9bf4-91ae4fb4d2f5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.317741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df889-49e6-4b95-9bf4-91ae4fb4d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.318012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df889-49e6-4b95-9bf4-91ae4fb4d2f5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.319473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 382/761] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:14.321823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df889-49e6-4b95-9bf4-91ae4fb4d2f5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.334074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f407391-f4ca-429b-8672-91da6436bb06 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.376356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.377032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.377311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.377581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.385927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.387648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5d6611c6-25b4-45ee-bdb5-52c5436c43f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:14.400026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:14.400955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:14.401821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 380/762] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:14.407269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.407269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.407269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.422624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:14.423793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:14.466687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df889-49e6-4b95-9bf4-91ae4fb4d2f5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.490506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:14.505820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.506464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.506739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.507008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.508401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 381/763] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:14.509546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.529681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.531304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:14.553627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:14.555365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:14.556256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 383/764] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:14.557102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.564017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:14.640641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb710-42cc-4bb7-b8c4-003c0931e4ed None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.667053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a56c0-c330-4835-804e-3cad8c096c8b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.689820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.690805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.691158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.691903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.693031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:14.693412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.695573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.702693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.703327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.703605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.703872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.704492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.705877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.715024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 382/765] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:14.715423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:14.717619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:14.719599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:14.721512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.721656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 384/766] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:14.728749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.802813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:14.860569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff91b-6e9b-46ed-ada0-44ecb208359e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.863189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:14.872105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fc0f-cd5d-4d53-91d9-7aa51101693f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:14.902126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.902753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.903041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.903316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.904075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:14.904382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.905835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.915683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:14.916336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.916641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.916883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.917719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=832e2dbf7ce74ba6b43daf615a19a999) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:14.917976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:14.918588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 383/767] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:14.919461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23a82b-ed33-4d10-afd1-da95166a515a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:14.921936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:14.925216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 385/768] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/role_assignments?user.id=832e2dbf7ce74ba6b43daf615a19a999&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:14.926421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828378-b7c2-4047-bdef-87eb0d2935ca None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:14.926707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828378-b7c2-4047-bdef-87eb0d2935ca None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:14.926985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828378-b7c2-4047-bdef-87eb0d2935ca None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:14.928479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 386/769] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:14.929231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4828378-b7c2-4047-bdef-87eb0d2935ca None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.043085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4803-c9a3-4f1e-8c5f-a56dc2f8a5ba None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.052100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4828378-b7c2-4047-bdef-87eb0d2935ca None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.062645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.082273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.082930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.083261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.083600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.084217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:15.084882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.086968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7fd27-e33a-4738-a252-7d05539299e3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.092181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 384/770] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Jul 27 08:21:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:15.097320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.097484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568976-fba8-46e3-a203-9aca1d0c5860 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.097484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568976-fba8-46e3-a203-9aca1d0c5860 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.097484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568976-fba8-46e3-a203-9aca1d0c5860 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.097727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.097727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.097727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/bb119ceb349f429aacde98d2940dde47/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.099373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 385/771] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:15.099955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=bb119ceb349f429aacde98d2940dde47, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.100567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24103d-da53-4fc1-b6fb-f55d23b0ed4c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.100881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24103d-da53-4fc1-b6fb-f55d23b0ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.101165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24103d-da53-4fc1-b6fb-f55d23b0ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.101982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.120984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dd24103d-da53-4fc1-b6fb-f55d23b0ed4c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:15.122346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dd24103d-da53-4fc1-b6fb-f55d23b0ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:15.145146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.171895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 387/772] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:14 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/bb119ceb349f429aacde98d2940dde47/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:21:15.172979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.211467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 386/773] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:15.213451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.213905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.214359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.250454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:15.251753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:15.309440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dcfc5-a356-44fe-8811-d15553715bc7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.336770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 387/774] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:15.336770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.357462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.358097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.358373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.358640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.359420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:15.359723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.361117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.368423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 388/775] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:15.369295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.413530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.437731 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.450044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f5fe-b818-4a1f-8d5a-b866a670b17c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.485984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.486639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.486987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.487369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.502586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:15.507912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:15.508909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:15.509758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 388/776] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:15.510449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.525887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d66b6-abc6-47e9-8d14-7cd5b6beeb13 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.574830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.575582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.575926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.576266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] PATH_INFO: `/v3/services/network` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.576995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.578430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:15.591549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:15.592605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:15.593488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:15.596864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 389/777] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:15.597846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.647129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bacbf2-f7e6-465a-b641-f4f28daf20a0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.699466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.700716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.701572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.702130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.703187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] RBAC: Adding query filter params (interface=public, service_id=bb375d6090214e7591e9165fe93ecabe, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:15.704200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.706190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.710845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.717295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975935-0f28-40a8-b33a-765ae2a6a65f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.718493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 389/778] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/endpoints?service_id=bb375d6090214e7591e9165fe93ecabe&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:15.720512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.736069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.767307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.768662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.769218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.769666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.770701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:15.771527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.773535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.784898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 390/779] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:15.785982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.834356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5e369-cfa7-41da-af48-d72a19bce81f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.871460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.872245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.872756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.873133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.873948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:15.874529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.875957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.885142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 390/780] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:15.886135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:15.917849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1b915-0f93-4629-b2d1-5d763cae212c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:15.963996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:15.965307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:15.965595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:15.965867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:15.966518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:15.967887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:15.975551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:15.981062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 391/781] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:15.982695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:16.002207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7288b-ae44-4356-ac54-0f0db5f782a8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:16.019381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:16.073397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:16.074588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:16.075915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:16.076559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:16.096907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:16.100464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:16.198147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a513-bae4-4fdb-b020-3e3422bebe88 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:16.235583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:16.236206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:16.236500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:16.236781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:16.237455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] RBAC: Adding query filter params (type=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:16.237754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:16.239116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:16.245216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 392/782] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:16.247118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:16.247988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:16.249057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:16.249057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:16.249057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:16.249057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:16.250936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:16.251119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 391/783] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:16.256771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:16.405291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:16.407384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca787-fdb8-4425-b44a-13c1cd649b57 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:16.432989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157152e1-f455-45b8-9068-2ef98bf83aaf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:16.470698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:16.471319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:16.471648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:16.471925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:16.472668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] RBAC: Adding query filter params (interface=public, service_id=c095b67962ba4c299c09ae6c7f636bcc, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:16.473074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:16.476799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:16.477131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:16.483323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 393/784] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:16 2022] GET /identity/v3/endpoints?service_id=c095b67962ba4c299c09ae6c7f636bcc&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:16.488636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:16.490432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:16.491111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:16.491401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:16.491676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:16.492411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:16.492718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:16.500805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:16.534809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 392/785] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:16.542664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:16.602621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e5a1-02fe-4dfb-8ae1-0996c2d70275 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:16.637428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:16.638045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:16.638323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:16.638592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:16.639234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:16.640599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:16.646806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 394/786] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:16 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:16.770004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac33ee6-5b2e-4f17-b2e5-2a3abc1facdb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:16.817152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:16.817803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:16.818081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:16.818358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:16.827191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:16.828679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:16.841666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:16.842654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:16.844036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 393/787] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:16.849886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:16.877955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:16.971581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71858937-fbc6-4adc-960e-efa3f39db8ed None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.007310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.008454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.008757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.009118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.009914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:17.010221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:17.011908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3759fb3-1e96-4d5d-af36-fbcba17f5255 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:17.031127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 395/788] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Jul 27 08:21:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:17.036291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.122165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.175340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb878b-1390-4f6c-86ef-cf16c1e1c5a1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.175622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb878b-1390-4f6c-86ef-cf16c1e1c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.175899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb878b-1390-4f6c-86ef-cf16c1e1c5a1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.177525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 396/789] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:17.182502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.182783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.183055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.194782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc0e19-b705-4816-a30e-1f337e5b4cbf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.204179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:17.205398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:17.260614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.261285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.261821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.262094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.281504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:17.283322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:17.305417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:17.306442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:17.307917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:17.307917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:17.307917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:17.307917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:17.307917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 394/790] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:17.308379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 397/791] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:17.312532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.342929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.349043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.417357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3967-b66a-4ee5-8668-fecb46ac51de None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.425750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.454102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.454727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.455104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.455378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.456064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:17.456390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:17.457809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcdd51-209e-4d2e-a9ef-65b307ca4244 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:17.470872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 395/792] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:17.471913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477333e4-3480-425c-9ccf-db3f777614a8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.472199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477333e4-3480-425c-9ccf-db3f777614a8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.472473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477333e4-3480-425c-9ccf-db3f777614a8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.483060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 396/793] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:17.483060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477333e4-3480-425c-9ccf-db3f777614a8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.516947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557113d-7d23-4f46-b0d3-13f29d167e0d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.554095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b994d82-3cf6-4537-b6f5-92395a64198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.555912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994d82-3cf6-4537-b6f5-92395a64198f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.556444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994d82-3cf6-4537-b6f5-92395a64198f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.556959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994d82-3cf6-4537-b6f5-92395a64198f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.568290 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b994d82-3cf6-4537-b6f5-92395a64198f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9b994d82-3cf6-4537-b6f5-92395a64198f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:17.574013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:17.574964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:17.575806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:17.578587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 398/794] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:17.580137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.580765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.581281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.590325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477333e4-3480-425c-9ccf-db3f777614a8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.601710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:17.603184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:17.626270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.626912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.627192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.627453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.635351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:17.637205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:17.650124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:17.651051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:17.651935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:17.656129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 397/795] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:17.657524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.671022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.681191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.683288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 399/796] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:17.685182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.765863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d567dc2-f7e4-486d-96b6-ff059baa899d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.792850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb9510-df4a-4659-ae1a-69b1592b5642 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.802750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.803417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.804047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.804720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.805462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:17.805766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:17.807261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:17.821029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 398/797] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:17.821029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.842684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.843533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.843964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.844521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.845548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:17.846037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:17.847812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:17.861287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 400/798] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:17.862399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:17.912697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.921584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:17.932599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c3a9a-1a58-4073-8736-5f585cdff73f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.969144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:17.970075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:17.970558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:17.971001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:17.973080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986639a-bfe8-4b6e-89cc-805cc7a8d5fb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:17.982784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:17.989278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:17.990218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:17.991043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:17.993816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 399/799] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:17.994737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.011232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.012407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.012826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.013206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.026077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.027815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:18.044267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:18.045463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:18.046494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:18.046494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:18.046494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:18.046494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:18.051911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 401/800] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:18.053032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.106587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f86f9-d022-44bc-83a5-e1882d854cb2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.143171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.144208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.144678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.145154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/d4612a994b4a481bac7f122c9ebe8405/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.147723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=d4612a994b4a481bac7f122c9ebe8405, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.150135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.163493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6df3a-db1c-4b75-862c-afe15e10e051 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.167950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:18.201349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.201981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.202272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.202532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.203270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:18.203582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.204981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.214638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 402/801] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:18.215235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.236909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 400/802] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:17 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/d4612a994b4a481bac7f122c9ebe8405/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:21:18.238177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.241718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:18.371213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f31ea6-70ab-442d-afd3-ea177afa8607 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.415329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.416064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.416245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.416517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.429191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.430454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.436258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b10b-a145-4ce8-8d3d-48e7f9b5618b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ebac2ab6-9c65-457d-8e0d-ee2e3cd7d7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:18.446518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:18.447449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:18.448337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:18.448337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:18.448337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:18.448337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:18.448337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 401/803] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:18.450118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9e3bd-5cc2-4316-bc32-a7b0e1fd962b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.450118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9e3bd-5cc2-4316-bc32-a7b0e1fd962b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.450118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9e3bd-5cc2-4316-bc32-a7b0e1fd962b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.451392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 402/804] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:18.457645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.457926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.458203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.477259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.477882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.478168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.478443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.478782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:18.479132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:18.479462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.480630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:18.480877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.493699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 403/805] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:18.494806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.534259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:18.557394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:18.582066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 403/806] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:18.589542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.633201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe71c5-6c8b-4f8d-8177-a78a50e5802b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.669545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.670496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.670609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.670878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.671569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:18.671875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.673281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.687135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 404/807] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:18.688281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.707988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9880-6142-4b33-936b-7a6ebb358f46 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.746914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.748475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.749068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.749616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.758806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.761308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:18.775257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:18.778090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:18.779047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:18.780384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 404/808] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:18.781661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.783557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:18.800537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2ef94-aa36-4791-a635-f33ccdf4b287 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.832945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:18.839465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.840194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.840527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.840835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.841468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.843265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:18.853252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:18.854435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:21:18.855284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:18.860881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 405/809] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:18.862214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.899918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8acc6-f530-4f45-b6c1-cf0eebbc554c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:18.937538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:18.938605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:18.939115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:18.939607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:18.949187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:18.951001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:18.964147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:18.965129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:18.966071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:18.968781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 405/810] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:18.969760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:18.971054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570969d-3dcd-4858-ad23-ba52b085942a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.009675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.009675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.009982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.010222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.010964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:19.011273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.013229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.033488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 406/811] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:19.034486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.046398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.084020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483361e0-8528-46fb-bdbc-4be1ab494cd6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.087145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.124923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.125813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.126303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.126814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.128008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:19.128607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.131191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.136708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 406/812] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Jul 27 08:21:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:19.138249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.147575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6afc-d2d9-4d44-8d5c-d2a50a3ca94c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.186098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.186697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.187019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.187295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.188036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:19.188342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.190208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.210371 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 407/813] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:19.211178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.250499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14768fa-1537-40e3-87e6-1245331b5e4b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.284551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.285553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.286043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.286557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.286696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.298596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.300257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-596dfeaa-e84a-406c-b600-13c8502a6cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:19.315588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:19.316538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:19.317450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:19.317450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:19.317450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:19.317450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:19.317450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 407/814] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:19.318331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14c2a-90f2-492e-b5cc-12487a3ff1e8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.318331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14c2a-90f2-492e-b5cc-12487a3ff1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.318460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14c2a-90f2-492e-b5cc-12487a3ff1e8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.320125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 408/815] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:19.325355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14c2a-90f2-492e-b5cc-12487a3ff1e8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.331581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467309-7ee7-4670-ba88-31941177ddda None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.346585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.370073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.370747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.371030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.371361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.372037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:19.372343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.373820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.379956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 408/816] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:19.380495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.441144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14c2a-90f2-492e-b5cc-12487a3ff1e8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.478800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.479535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.479838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.480216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.494807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acb737-a2a9-430e-828c-4a00e7cf1cd9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.532585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.539735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.540446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.540633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.540940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.541628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:19.544668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.544668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6db31-75aa-4d3e-bc3f-d4e3ac4402b6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.555562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 409/817] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:19.557703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.558204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.558710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.563522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.565017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.578789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:19.580150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:19.590018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.660857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 410/818] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:19.661762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.684086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 409/819] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:19.685281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.767934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919480-75b1-4c33-97b2-05dcc9eba6e6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.789610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.794542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8bd10-d160-4ddf-91f7-6649788576aa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:19.803678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.804581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.804905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.805186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.805904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.807284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.816918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:19.831892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:19.837328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:19.837328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:19.837328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:19.840364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:19.841825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:19.853674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:19.854774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:19.855711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 410/820] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:19.856196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.919306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 411/821] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:19.920146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:19.975533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d391556-3c9b-4c15-a18f-4f2d98abd2e8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.025845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.026884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.027376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.027883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] PATH_INFO: `/v3/services/network` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.028737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.030235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:20.040124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:20.041206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:20.042052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 411/822] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:20.042872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.066084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b20e39-0213-4a1d-b74b-0f99e797f0a9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.090876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.115622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.117240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.117683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.118061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.129430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.130889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:20.149091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:20.150214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:20.151337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:20.151337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:20.151337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:20.151337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:20.155011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 412/823] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:20.155861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.162174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789bde6-db7c-4916-903a-c7fb7b1bd889 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.188613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.210043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.211366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.211651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.211928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.212681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:20.213065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.214492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.228340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 412/824] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:20.229072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.290637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413a32e-ecdb-4a70-8629-ee9b51e85a1c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.333107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.333734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.334018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.334292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.334970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] RBAC: Adding query filter params (name=network) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:20.335332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.336576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.336897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.339816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbf657-5d4f-4854-948d-1c51bc2465d1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.341678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 413/825] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:20.342732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.385149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.385820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.386094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.386649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.387342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:20.387646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.389598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac91625-df43-41a5-bdfb-6d460de585b7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.404110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 413/826] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:20.408764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45106-6dbf-4c91-948c-8992ea21d8dc None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.408764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45106-6dbf-4c91-948c-8992ea21d8dc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.408764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45106-6dbf-4c91-948c-8992ea21d8dc None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.408764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 414/827] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:20.408764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45106-6dbf-4c91-948c-8992ea21d8dc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.451739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.461771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83651da3-e243-4e6a-a6e4-69eba4760984 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.508565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fc513-e537-4fe0-a4a2-42369f0a2d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.509268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fc513-e537-4fe0-a4a2-42369f0a2d76 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.509548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fc513-e537-4fe0-a4a2-42369f0a2d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.509820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fc513-e537-4fe0-a4a2-42369f0a2d76 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/832e2dbf7ce74ba6b43daf615a19a999/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.520332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45106-6dbf-4c91-948c-8992ea21d8dc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.525349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fc513-e537-4fe0-a4a2-42369f0a2d76 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=832e2dbf7ce74ba6b43daf615a19a999, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.526800 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fc513-e537-4fe0-a4a2-42369f0a2d76 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.557552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.558090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.558370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.558644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.559317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] RBAC: Adding query filter params (type=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:20.559615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.560991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.565666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 415/828] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:20.570124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.593090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.600767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 414/829] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:20 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/832e2dbf7ce74ba6b43daf615a19a999/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:21:20.600767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.600767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.600767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.630160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:20.632652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:20.690095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32e5e8-f99a-4ae2-9349-8ec20c427b40 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.724788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 415/830] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:20.724788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.754860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.756897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.757704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.757974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.768069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.771557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:20.788094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:20.789726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:20.790778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 416/831] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:20.791782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.824444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.856057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b630802-6263-415d-9d51-bed1cf2d221e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.902706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.904010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.904472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.905164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.906028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:20.908251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:20.910150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:20.926326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb537-7d4b-41cf-b7ba-9760e741b9bb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:20.959383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:20.960016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:20.960851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:20.961137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:20.970957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:20.975798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:20.977619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:20.978468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 417/832] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:20.979214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:20.991813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 416/833] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:20.997266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:21.133760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309fa8-1e58-4db0-94b7-cc74a5115b23 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.165118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:21.181577 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.183951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.184549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.185026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.186690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:21.187372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.189433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:21.203760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 417/834] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:21.210152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:21.214661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616359-ab77-4c94-a987-45f732973ab8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.265118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.265961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.266316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.266665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.267488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:21.268317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.269879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:21.286771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 418/835] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:21.293067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:21.298832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:21.357459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08a794-b3d2-440c-8a37-7cae65023d1f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.408992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.409713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.410098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.410482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.425661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.427756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:21.447057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f138-1e59-46d7-aad7-efa0117f15cd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:21.450280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:21.451339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:21.452449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:21.452449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:21.452449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:21.452449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:21.459254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 418/836] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:21.461586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:21.489843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.490606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.491016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.491695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.492752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=bb119ceb349f429aacde98d2940dde47) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:21.493157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.494733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:21.504182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 419/837] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:21 2022] GET /identity/v3/role_assignments?user.id=bb119ceb349f429aacde98d2940dde47&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:21.508544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:21.581689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487c87-a317-44f0-bc57-6a619cfbb26e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.620050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.621439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.621875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.622301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.623185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:21.623644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.625255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:21.644003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 419/838] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:21.645673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:21.730288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:21.757209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bbc25-f26a-49b3-9961-61643f41a20f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.795602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.796254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.796542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.796968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.805892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.807478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:21.824487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:21.825529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:21:21.826445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:21.830564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 420/839] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:21.831951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:21.946327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db752825-0b61-4b56-a7a1-8925b9d0b17e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:21.956546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:21.996251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:21.996806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:21.997095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:21.997369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:21.998168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:21.998477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:21.999913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8965-021a-40af-badb-827aea481a85 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.028945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 420/840] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Jul 27 08:21:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:22.033396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.176911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3024f-9828-49f6-8d12-c6b7f0af1928 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:22.189042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cec1d5-11a0-4e13-af54-5e9b55968447 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.189505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cec1d5-11a0-4e13-af54-5e9b55968447 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.189877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cec1d5-11a0-4e13-af54-5e9b55968447 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.191508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 421/841] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:22.198023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.198338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.198583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.215772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:22.220713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:22.222173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:22.224958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:22.226432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.230103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.230103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.316855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 422/842] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:22.317029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:22.317110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.338151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.449919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:22.464559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 421/843] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:22.467274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.473717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f0b4d-edeb-4cbf-aea2-e7ad8c1ae72d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:22.507724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:22.536067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:22.536911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.537631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.538006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.538774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:22.541121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:22.555041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:22.557159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:22.564029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 423/844] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:22.566716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.612760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2642762-eda0-4f11-8d10-f68bcaabbaa9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:22.655913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:22.657322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.657915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.658338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.670915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:22.672749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:22.688897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:22.690034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:22.691125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:22.691125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:22.691125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:22.691125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:22.697813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cddb7-c24c-4c70-a71e-9ea0ae3a266d None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:22.698765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 422/845] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:22.700671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.739230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:22.740057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.740937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.743614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.743614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:22.743614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:22.745172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.751221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 424/846] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:22.759159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.777186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:22.814579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:22.834996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625534-c032-4635-9ddb-a463f0c443df None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:22.874803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:22.875659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.875775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7913-3af8-4fa5-8ce4-857d60fe249f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:22.876196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.876608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.877731 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:22.879054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:22.880561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e94ea-da49-4aaa-9dfd-a4b55c71c53f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.896721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 423/847] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:22.899680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7928-ad70-4154-80e3-9e7f1a0b55f4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.900105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7928-ad70-4154-80e3-9e7f1a0b55f4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.900798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7928-ad70-4154-80e3-9e7f1a0b55f4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.903111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 424/848] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:22.904214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7928-ad70-4154-80e3-9e7f1a0b55f4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:22.912404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:22.913062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.913863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.914137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.914906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:22.915218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:22.916596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e765e49-11fe-477b-815f-4a2ac0c24a24 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:22.921363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 425/849] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:22.924286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:22.924749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:22.925144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:22.951302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:22.952681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:23.040185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7928-ad70-4154-80e3-9e7f1a0b55f4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.042092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 426/850] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:23.070289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.082488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:23.088103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.088909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.089296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.089680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.097396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:23.098959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:23.103109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:23.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:23.114175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:23.115227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 425/851] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:23.120902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.209366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a723-4583-4d0e-a898-0938cd0f551e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.230017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993ac6-21e9-4981-a6dc-2690b3e1ceb7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.258574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.259658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.259942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.260222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.267972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.268872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.269415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.269885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.270814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:23.271302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:23.273046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:23.273342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:23.279288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:23.280227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:23.285647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 427/852] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:23.288937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.290862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 426/853] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:23.296192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.363487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:23.377070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:23.410265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df774c-645d-48fb-b81a-c482ecec8184 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.426404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49200a-5e2c-4209-9f28-63da165152b8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.456443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.457364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.457650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.457929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.459072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:23.459441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:23.461611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:23.471580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.472484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.473008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.473484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.474492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=d4612a994b4a481bac7f122c9ebe8405) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:23.475040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:23.476210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 428/854] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:23.477112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:23.477510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.485593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 427/855] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/role_assignments?user.id=d4612a994b4a481bac7f122c9ebe8405&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:23.602185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa7be-7b0e-4d7c-b32a-d8cee11ccfdd None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.635930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:23.642994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.643685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.643914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.644181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.660778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:23.662315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-54b43941-f86a-4c42-9289-9a32e699a50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:23.679286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:23.680217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:23.681154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:23.681154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:23.681154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:23.681154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:23.684806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 429/856] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:23.686599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.762069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05209-d85f-410e-8a80-e2f68e7eb284 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.762627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05209-d85f-410e-8a80-e2f68e7eb284 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.762627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05209-d85f-410e-8a80-e2f68e7eb284 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.764084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 430/857] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:23.768955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.769172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.775532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.788009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:23.789499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:23.806922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1078dff-961c-41eb-b333-d76e7df64914 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:23.831821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:23.842948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:23.844188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:23.844188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:23.844188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:23.844859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:23.845167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:23.846531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:23.863579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 428/858] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:23.864588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.879271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 431/859] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:23.902738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:23.970770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d760bf-c155-40ee-b9b0-52ccc8a93adf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.007718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad2d48-774e-4173-a637-4adc68bd07bc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.009199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.009971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.010361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.010737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.018868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.020363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.023560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:24.033766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:24.034941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:24.036089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:24.037635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 429/860] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:24.046050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:24.051792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.051792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.051792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.051792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.052135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.052553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:24.062414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:24.063373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:24.064319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:24.072278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 432/861] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Jul 27 08:21:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:24.074866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:24.105851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:24.171478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0394a3d-e734-4d9f-98d2-1499a911427c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.214582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.215039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813f307-76a6-4844-b123-c2866d0ce4ba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.215801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.216337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.216974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.218741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:24.219229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.220841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.242628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 430/862] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:24.248307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:24.256050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.257436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.257892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.258349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.259193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:24.259666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.261553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.270942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 433/863] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:24.271994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:24.324392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:24.359120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8046e-80a5-4505-bd8a-87a2830e6868 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.361010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:24.396633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f94f63-ba5f-4bda-b2d0-feff64c2c532 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.401054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.401674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.401953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.402226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.434860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.435815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.436368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.436961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.437825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:24.438329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.440153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.446377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 434/864] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:24.485513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.487422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.610302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 431/865] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:24.615845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:24.723921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ab366-aaf0-468c-9970-93f69fae5b03 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.726372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:24.759691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.760332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.760611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.760914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.772035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.773666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:24.789412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:24.790337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:24.791198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:24.791198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:24.791198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:24.791198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:24.793425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 435/866] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:24.798750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:24.801127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:24.906130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891ea1-6470-42f8-9330-817ce2dd2cfe None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:24.942219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:24.943256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:24.943743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:24.944213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:24.945646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:24.946167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:24.947714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce75b42-1ded-4399-b858-4ef19f157885 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:24.960659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 432/867] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:24.966478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:25.036576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b87c1-61ff-4cf8-96df-f029882f0240 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.036936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b87c1-61ff-4cf8-96df-f029882f0240 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.037167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b87c1-61ff-4cf8-96df-f029882f0240 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.039324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 433/868] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:25.044273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.044556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.044858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.064222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:25.065549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:25.084440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31f7d-8695-42cb-8f29-a67a9634a851 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:25.127609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:25.128247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.128528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.128827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.134967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:25.139899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:25.141513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:25.151433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 434/869] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:25.156756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:25.157607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:25.158489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:25.160868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 436/870] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:25.168224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:25.177763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:25.197761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:25.281641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a04dc-48cb-41b3-a1de-3685cf1b37cb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:25.282361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08ff5d-824e-4f05-a3a6-5c49f3b10504 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:25.317053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03259d2d-5552-4808-ae7c-fb7e25433f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:25.317768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259d2d-5552-4808-ae7c-fb7e25433f93 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.318028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259d2d-5552-4808-ae7c-fb7e25433f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.318300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259d2d-5552-4808-ae7c-fb7e25433f93 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.319028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259d2d-5552-4808-ae7c-fb7e25433f93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:25.320594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259d2d-5552-4808-ae7c-fb7e25433f93 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:25.322375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:25.323219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.323719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.324261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.325365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:25.325893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:25.327396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:25.340220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 435/871] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:25.345866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:25.401115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:25.414191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 437/872] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:25 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:25.459578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d328-2892-40d9-a3e9-615e221f9c21 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:25.515965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:25.516612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.516934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.517208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.518021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=832e2dbf7ce74ba6b43daf615a19a999) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:25.518331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:25.519819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c0d13-ec2f-44a6-b543-cf920a51e1fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:25.527824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 436/873] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:25 2022] GET /identity/v3/role_assignments?user.id=832e2dbf7ce74ba6b43daf615a19a999&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:25.664147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf423dc-4c9c-42a0-be4c-5c6b37d49ee2 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.664560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf423dc-4c9c-42a0-be4c-5c6b37d49ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.664788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf423dc-4c9c-42a0-be4c-5c6b37d49ee2 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.666513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 438/874] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:25.672325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.672613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.672938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.692397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:25.693647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:25.772827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 437/875] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:25.794816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf423dc-4c9c-42a0-be4c-5c6b37d49ee2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:25.883132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:25.912922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf423dc-4c9c-42a0-be4c-5c6b37d49ee2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:25.951362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:25.951929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:25.952212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:25.952487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:25.953151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:25.954528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:25.964122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:25.965173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:25.966010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:25.970455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 439/876] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:25.971837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:26.019949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:26.078779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b44f4-fcbb-49f1-aa56-b4e496e853ff None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:26.114688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:26.115311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:26.115596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:26.115877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:26.116625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:26.117004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:26.118493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bcc94-b6c5-4ebe-8702-e6c646aaab02 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:26.128190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 438/877] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:26.129579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:26.240911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc30c8-afc3-4fb6-9f95-fb81aa2cd3c7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:26.277344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:26.278007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:26.278292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:26.278621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:26.279303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:26.279611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:26.281003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e717641-80de-4355-927f-b810a4c1f0cc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:26.286037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 440/878] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:26.626356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294299f-d68d-4fd4-87c4-83a0adee2d59 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:26.626356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294299f-d68d-4fd4-87c4-83a0adee2d59 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:26.626356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294299f-d68d-4fd4-87c4-83a0adee2d59 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:26.626356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 439/879] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:26.635689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068f3c0-5ed8-45d2-8499-03159ea5114e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:26.635689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068f3c0-5ed8-45d2-8499-03159ea5114e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:26.635689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068f3c0-5ed8-45d2-8499-03159ea5114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:26.642231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:26.654080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9068f3c0-5ed8-45d2-8499-03159ea5114e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:26.655526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9068f3c0-5ed8-45d2-8499-03159ea5114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:26.726364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 441/880] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:26.748984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294299f-d68d-4fd4-87c4-83a0adee2d59 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:26.858231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294299f-d68d-4fd4-87c4-83a0adee2d59 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:26.867226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:26.897063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d539008-93a5-40e0-a529-d2164f30a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:26.898207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d539008-93a5-40e0-a529-d2164f30a77e None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:26.898492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d539008-93a5-40e0-a529-d2164f30a77e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:26.898767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d539008-93a5-40e0-a529-d2164f30a77e None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:26.899473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d539008-93a5-40e0-a529-d2164f30a77e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:26.900863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d539008-93a5-40e0-a529-d2164f30a77e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:27.013316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 440/881] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:26 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:27.489541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d248-439d-4dc7-b924-23ce397d36d1 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:27.490063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d248-439d-4dc7-b924-23ce397d36d1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:27.490063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d248-439d-4dc7-b924-23ce397d36d1 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:27.491617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 442/882] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:27.502641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:27.503220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:27.503715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:27.529609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:27.531117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:27.608060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 441/883] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:27.630486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d248-439d-4dc7-b924-23ce397d36d1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:27.736618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d248-439d-4dc7-b924-23ce397d36d1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:27.776354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:27.776947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:27.777227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:27.777501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:27.778125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:27.779497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:27.781406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-edd00935-9b91-45ea-831c-175ac4d229b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:27.789956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:27.790990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:27.791811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 443/884] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:27.799335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:27.801883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6eb3-4c39-44d6-88fc-8dd9f90f0625 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:27.802258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6eb3-4c39-44d6-88fc-8dd9f90f0625 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:27.802540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6eb3-4c39-44d6-88fc-8dd9f90f0625 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:27.804113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 444/885] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:27.809220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:27.809504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:27.809781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:27.830509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:27.832187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:27.901003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:27.907501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 445/886] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:27.912977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb3b2-27d3-4ae5-b148-003d41b0ea84 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:27.930871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:27.948277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:27.949836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:27.950133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:27.950387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:27.951075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:27.951384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:27.952914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:27.958213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 442/887] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:27.964643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.058521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d12ce7-59db-4788-86b8-3939bbde10c6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.094156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:28.095929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6a19-72bf-4e14-8504-9d0369beeadf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.105110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.106493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.106980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.107432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.122996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:28.130303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:28.131307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:28.132356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:28.139188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 446/888] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Jul 27 08:21:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:28.141034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.145141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.146016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.146505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.146983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.148414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:28.149067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.150702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.156700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 443/889] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:28.161955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.185819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:28.270888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ccd72-d1c4-4d23-83be-c7f688bc45d9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.271756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbaad-5bfd-48a0-a9d8-32c19813f216 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.312644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.313431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.313858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.314210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.315141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] RBAC: Adding query filter params (interface=public, service_id=103083cc837a4817bf810975ce7e5e5b, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:28.315526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.317108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1875-085d-42d5-b482-3215e95f47de None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.317216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.318022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.318470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.318938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.319879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:28.320391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.322035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c8013-26e2-454b-beab-0af0a31ca626 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.323346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 444/890] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:28 2022] GET /identity/v3/endpoints?service_id=103083cc837a4817bf810975ce7e5e5b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:28.326267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076c6b-b0f7-4ecc-b14f-9617bc5fca7a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.326627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076c6b-b0f7-4ecc-b14f-9617bc5fca7a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.326979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076c6b-b0f7-4ecc-b14f-9617bc5fca7a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.329094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 445/891] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:28.329880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076c6b-b0f7-4ecc-b14f-9617bc5fca7a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.332153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 447/892] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:21:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:28.333347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.333687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.333960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.353292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:28.354465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:28.399344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:28.423106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 448/893] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:28.423972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.432496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:28.450049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076c6b-b0f7-4ecc-b14f-9617bc5fca7a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.493868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.494767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.495057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.495340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.496284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.499583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.505864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 446/894] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:28 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:21:28.507509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.544915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa1ba-f181-4e89-b40f-e33a08ee2320 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.589170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.590445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.590965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.592133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.607344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.609498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:28.633212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:28.634246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:28.635124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:28.635124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:28.635124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:28.635124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:28.635124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 449/895] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:28.643409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c73897-8718-46ac-979d-dd2f5462d55b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.643625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.677399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:28.684246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.685280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.685765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.686233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.687117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.688700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.755884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51133d22-7e80-4852-be09-fa8190c73adb None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.759329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 447/896] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:28 2022] POST /identity/v3/services => generated 241 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:28.807879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.808518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.808896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.809176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.809895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:28.810205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.811714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:28.831516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 450/897] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:28.833162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:28.846351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:28.950695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44891f-7469-491b-a9d6-01aab7f1003d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:28.986499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:28.987151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:28.987437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:28.987716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:28.995972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:28.997457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1ee1a848-2739-44c8-89ae-3828be2d3eff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:29.010169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:29.011397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:29.012310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:29.016324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 448/898] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:21:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:29.018071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.115874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.129048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5c4e-7edf-4ef6-8a39-649d932b88ac None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.144483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bcc9c-35c6-4da0-89d6-38e1289425b1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.145080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bcc9c-35c6-4da0-89d6-38e1289425b1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.145080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bcc9c-35c6-4da0-89d6-38e1289425b1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.146768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 449/899] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:29.152447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.153032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.153516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.172174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.172827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.173114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.173392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.174185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:29.174498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.175596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:29.175916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.177233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:29.199975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 451/900] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:29.201272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.261565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.275444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 450/901] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:29.294127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.329018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852211-d46a-4885-a9c3-efc06f8c34e9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.369369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.370322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.370811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.371289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.387906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.406636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300802f9-12e7-415b-90df-b25bd0003840 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.455185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.455841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.456400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.456681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.457146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.457346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.458794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.458921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:29.470841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:29.471845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:29.472852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 451/902] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:29.480252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.574518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.580671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 452/903] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:21:29.582496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.624052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d5840-0ba7-440a-b5e2-06c4cf1f6cc7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.634145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.660507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.661424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.661878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.662303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.663793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:29.664258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.665848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.671421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 452/904] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:29.676967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.696978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3bb9a-b532-4ebc-ac5d-317305778eba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.744356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.745178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.745462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.745734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.759574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.762494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:29.782626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:29.783553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:29.784463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:29.784463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:29.784463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:29.784463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:29.788812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 453/905] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:29.790486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.804488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdf654-4ef3-4e12-be74-67cb4d32f5b0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.838622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.849058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.849688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.849970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.851739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.852282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:29.852634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.854293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.865197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 453/906] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:29.866979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.915852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:29.919469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c842-e96b-4e63-8209-2965607e1ff7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:29.955822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:29.956439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:29.956736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:29.957039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:29.957733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:29.958040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:29.959579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:29.979840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 454/907] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:29.981209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:29.983353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ae5c7-dff3-4cdb-b935-ce1f4bfa9c6f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:30.021094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:30.022010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.022991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.023451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.024375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] RBAC: Adding query filter params (interface=public, service_id=2ee2aa89a523445396d80f9da3a5519e, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:30.024862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:30.026374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:30.037004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 454/908] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/endpoints?service_id=2ee2aa89a523445396d80f9da3a5519e&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:30.039556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:30.093965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728704a2-7d48-4894-8fdf-b36466cc7d81 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:30.099683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:30.132276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:30.133033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.133419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.133853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.142321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:30.143950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:30.151169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c72ef-2b4e-4d59-bac7-252742fb5500 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:30.157421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:30.158490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:30.159408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:30.159846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 455/909] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:30.168499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:30.196309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:30.199356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:30.200073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.200473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.200926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.202128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:30.203882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:30.219883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 455/910] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:30 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:21:30.295238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03997418-3b4f-40a2-a96e-82f1367f7aba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:30.334847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:30.335973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.336258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.336533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.337328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:30.337638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:30.339100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9642-18fb-4f78-ae8e-28dfe5de06a9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:30.353496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 456/911] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:30.361950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:30.471195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb056b6-cf92-4caf-b067-0db42bc225c1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:30.489704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:30.509691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:30.510738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.511567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.512069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.513392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] RBAC: Adding query filter params (role.id=fefbc531a7ed46edbc4e45ebd033934e, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=832e2dbf7ce74ba6b43daf615a19a999) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:30.513392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:30.520750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5e03-370e-4ddb-b3d0-d3a0a02c2844 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:30.524849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 456/912] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:30 2022] GET /identity/v3/role_assignments?user.id=832e2dbf7ce74ba6b43daf615a19a999&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=fefbc531a7ed46edbc4e45ebd033934e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:30.624095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee066-efba-4bcf-a4b5-d249520df204 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.624618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee066-efba-4bcf-a4b5-d249520df204 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.624618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee066-efba-4bcf-a4b5-d249520df204 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.626493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 457/913] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:30.632681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538891d0-bc2e-416b-b88a-748189a6c652 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.633148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538891d0-bc2e-416b-b88a-748189a6c652 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.633524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538891d0-bc2e-416b-b88a-748189a6c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.653294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-538891d0-bc2e-416b-b88a-748189a6c652 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:30.654523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-538891d0-bc2e-416b-b88a-748189a6c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:30.726735 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 457/914] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:30.748901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee066-efba-4bcf-a4b5-d249520df204 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:30.836980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:30.860209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee066-efba-4bcf-a4b5-d249520df204 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:30.898523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:30.899053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.899335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.899611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.900241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:30.901705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:30.905629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084bf7-f72f-495a-b5a5-11c78cae0a96 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.906110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084bf7-f72f-495a-b5a5-11c78cae0a96 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.906578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084bf7-f72f-495a-b5a5-11c78cae0a96 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.909176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 458/915] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:30.911663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:30.913435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:30.914709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 458/916] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:30.915700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:30.915700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:30.916037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:30.922357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:30.937221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:30.939227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:31.029140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 459/917] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:31.033326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb6f5-5649-407f-a337-dc47d56aee80 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.046299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.071322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.071949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.072338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.072614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.073428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:31.073735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.075102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.080752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 459/918] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:31.086435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.092694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:31.096397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:31.151408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575074d3-5599-4aa0-a2c6-68df8a259f1d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.186775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.187419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.187695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.187968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.188596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.189985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.193600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45676-e1c9-4558-8d18-3c9cbb8b2dae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:31.199123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:31.200136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:31.201032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:31.205084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 460/919] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:31.207101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.234140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.235184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.235739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.236195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.237079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:31.237586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.239348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.249883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 460/920] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Jul 27 08:21:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:31.250929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.316556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab17d28-8a18-4c99-ad46-c80465e26d85 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.323883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:31.334103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:31.352137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.352779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.353143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.353342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.354011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:31.354373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.355784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.360795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa13205-cf99-496d-b3c8-c1e0178b2593 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.365590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 461/921] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:31.366515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.399398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.400419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.400973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.401453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.402375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.404084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.472297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f93dc-1399-4191-9a81-53899266e4d0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.489199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 461/922] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:31.527445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.528074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.528356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.528630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.529538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:31.529845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.531365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.537507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 462/923] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:31.546038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.658290 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d843-472c-45b8-9b7b-6bded0a461c7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.686591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:31.696011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.696744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.697102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.697381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.698280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] RBAC: Adding query filter params (interface=public, service_id=cb720191b08f4f5b932de8ad45ff7252, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:31.698602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.700042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd60aa7-6121-4a94-88e8-9205f266e5b8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.706234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 462/924] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:31 2022] GET /identity/v3/endpoints?service_id=cb720191b08f4f5b932de8ad45ff7252&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:31.713129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:31.745975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:31.823432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7502c-3538-434e-84e1-abfce3971c82 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:31.859156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f29b3-9ff6-4dbb-afdd-8313f0eb7964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:31.859796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f29b3-9ff6-4dbb-afdd-8313f0eb7964 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:31.860124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f29b3-9ff6-4dbb-afdd-8313f0eb7964 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:31.860405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f29b3-9ff6-4dbb-afdd-8313f0eb7964 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:31.861149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f29b3-9ff6-4dbb-afdd-8313f0eb7964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:31.862514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f29b3-9ff6-4dbb-afdd-8313f0eb7964 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:31.869550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 463/925] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:31 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:21:32.352139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a879e-8050-4f11-993a-6310858a4c1c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.352424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a879e-8050-4f11-993a-6310858a4c1c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.352923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a879e-8050-4f11-993a-6310858a4c1c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.354661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 463/926] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:32.360155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e1f0-c996-4177-b2f0-65f2f535c3c1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.361049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e1f0-c996-4177-b2f0-65f2f535c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.361552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e1f0-c996-4177-b2f0-65f2f535c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.380320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-eb22e1f0-c996-4177-b2f0-65f2f535c3c1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:32.382632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-eb22e1f0-c996-4177-b2f0-65f2f535c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:32.451842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 464/927] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:32.475040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a879e-8050-4f11-993a-6310858a4c1c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:32.598398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a879e-8050-4f11-993a-6310858a4c1c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:32.634448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:32.635014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.635298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.635575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.636497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:32.638300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fc1ba-bd23-4d5b-8054-6770190290e4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.638577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fc1ba-bd23-4d5b-8054-6770190290e4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.638855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fc1ba-bd23-4d5b-8054-6770190290e4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.640334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 465/928] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:32.641689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:32.645833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.646348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.646827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:32.652076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:32.653081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:32.653951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 464/929] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Jul 27 08:21:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:32.659280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:32.670983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:32.672552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:32.697699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:32.719081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:32.768334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 466/930] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:32.774990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856f0c-82fb-4860-8511-e661ef6def0f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:32.793245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:32.814914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:32.815954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.816420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.817137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.817628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:32.817934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:32.819646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:32.825081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 465/931] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:32.830795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:32.908769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a7a0c-8f11-4968-af93-a97042c3ea4b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:32.936667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331bab1-41dd-4a2d-90b2-fa19ca5d4659 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:32.947444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:32.948482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.948994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.949473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.954794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:32.962621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:32.968001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:32.971625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:32.972555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:32.974212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 467/932] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Jul 27 08:21:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:32.975220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:32.977362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:32.978065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:32.978422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:32.978764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:32.979513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:32.979889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:32.981395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:32.991762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 466/933] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:32.992756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:32.999248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:33.084154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119f9f8-2470-49fd-9e42-ec35f050421d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.102075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f534760-d70c-4bc8-8338-ac30552a6fd7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.120128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:33.120884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.121168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.121442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.122155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:33.122459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:33.123930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:33.137838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 468/934] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:21:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:33.138812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:33.138923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:33.139719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.140081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.140424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.141264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:33.142905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:33.224358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:33.246809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 467/935] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:33.247736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba9df-7993-4447-81fe-e1ae922c5e4d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.294401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:33.295058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.295341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.295618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.308875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:33.310470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:33.327473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:33.328521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:33.329476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:33.329476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:33.329476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:33.329476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:33.329476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 469/936] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:33.335436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:33.380104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:33.448016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740755-28e0-4c63-977e-cc52f77d1757 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.484597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:33.485265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.485548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.485821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.486515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:33.486822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:33.488194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:33.504321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 468/937] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:33.511925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:33.622284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a83c7b-dde9-4130-99a2-c304e508604c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.646702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:33.658336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:33.658974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.659253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.659526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.668129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:33.669578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-19aa3ea4-f5ee-429b-9d61-ee973d024a8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:33.681079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:33.682048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:33.683047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 470/938] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:21:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:33.690035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:33.726646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2387327-3f03-42ec-900b-342736057a91 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.726937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2387327-3f03-42ec-900b-342736057a91 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.727194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2387327-3f03-42ec-900b-342736057a91 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.728712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 471/939] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:33.733652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.733937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.734216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.753022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:33.754122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:33.808120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:33.812493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b41c7-e149-4b89-800c-bebf6ca1b635 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.840282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 472/940] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:33.852191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:33.853342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:33.853809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:33.854200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:33.855149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:33.855556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:33.857164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:33.862765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:33.878338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 469/941] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Jul 27 08:21:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:33.886267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:33.974946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3685a1-b98e-4e10-8fec-83e87c51218f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:33.990260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:33.997635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264901-1bb2-4ca5-8f1e-7a034a0ddff2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.012456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.012795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.013089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.013366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.014072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.015526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.018236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING keystone.server.flask.common [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 08:21:34.040987 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.041626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.041906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.042181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.052116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.054592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-618ab6de-9793-418e-ac87-f8868e89c6ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:34.068202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:34.069793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 470/942] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34b252-d08c-477f-a3c1-d335ec52b7c4 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34b252-d08c-477f-a3c1-d335ec52b7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.075689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34b252-d08c-477f-a3c1-d335ec52b7c4 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.077475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.sql.core [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 08:21:34.077475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 08:21:34.077475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [parameters: {'id': '4b187466880e4d768a68b040a4902ceb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 08:21:34.077475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80326) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 08:21:34.077752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 471/943] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:34.078347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34b252-d08c-477f-a3c1-d335ec52b7c4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.090099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ed96f409-dc50-4c8d-b054-52f06b661379 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b187466880e4d768a68b040a4902ceb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b187466880e4d768a68b040a4902ceb. Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:21:34.098803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 08:21:34.105701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application yield resource Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise self.value Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application session.commit() Jul 27 08:21:34.106671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.flush() Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application compat.raise_( Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 08:21:34.107578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 08:21:34.108482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:21:34.109338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [parameters: {'id': '4b187466880e4d768a68b040a4902ceb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.110212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:34.113016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b187466880e4d768a68b040a4902ceb. Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 473/944] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Jul 27 08:21:33 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.115377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.117898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.130512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:34.132870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:34.195242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34b252-d08c-477f-a3c1-d335ec52b7c4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.202953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 474/945] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:34.203986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.239474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.240093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.240375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.240694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.241543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:34.241852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.243371 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.256188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 472/946] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:34.257738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.312540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.316358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73ac1e-ce28-4dfe-89aa-9d22bb79aa0d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.327640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.353206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.353860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.354141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.354417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.361421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.362557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf31a9-86b2-4ceb-a54a-0ef903f64801 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.363070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:34.375902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:34.377002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.377917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 475/947] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:34.378384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.407639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.408399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.408685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.408988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.409612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.411325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:34.421210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:34.422225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:34.423053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 473/948] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:34.423847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.489460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f32e-c231-4334-83e2-a4c44cf82143 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.532206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.532967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.533219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.533430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.539017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e2a51-b620-4f51-991b-8251755d060e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.542259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.543692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:34.557077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:34.558167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 476/949] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:34.559558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.578015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.584046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.586286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.586286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.586286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.586643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.587199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:34.587497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.588950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.612768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 474/950] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:34.612768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.699006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c6795-9a1a-47ac-b698-bd52f74217e6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.731437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327894dc-ef62-4eb9-aedb-0afe7fdbd979 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.750615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.751967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.752428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.752902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.753801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:34.754293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.757561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.774762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 477/951] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:34.776247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.779588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.780216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.780494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.780801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.782065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:34.782065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.783360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.798369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 475/952] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:34.802899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.870531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.883105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:34.902602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acedc6-ebf5-4215-be1c-84b7327f4e0f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.927298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac646576-ab8f-44d2-9916-6821f444ec4f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:34.947572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.948464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.948959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.949798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.950639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:34.951095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.952591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:34.959839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 478/953] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:34.965628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:34.970451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae165d7-d32c-4d4b-9291-d43a41d0cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:34.971243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae165d7-d32c-4d4b-9291-d43a41d0cf18 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:34.971629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae165d7-d32c-4d4b-9291-d43a41d0cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:34.972027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae165d7-d32c-4d4b-9291-d43a41d0cf18 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/832e2dbf7ce74ba6b43daf615a19a999/roles/fefbc531a7ed46edbc4e45ebd033934e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:34.974439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae165d7-d32c-4d4b-9291-d43a41d0cf18 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=832e2dbf7ce74ba6b43daf615a19a999, role_id=fefbc531a7ed46edbc4e45ebd033934e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:34.977093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae165d7-d32c-4d4b-9291-d43a41d0cf18 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:35.049617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 476/954] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:34 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/832e2dbf7ce74ba6b43daf615a19a999/roles/fefbc531a7ed46edbc4e45ebd033934e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:21:35.085291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14bee0-9fb6-41ed-991a-664dcd509544 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:35.127932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1b7b0-268e-4ea9-a4c1-2e0a1ae8e34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:35.128632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1b7b0-268e-4ea9-a4c1-2e0a1ae8e34e None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:35.129076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1b7b0-268e-4ea9-a4c1-2e0a1ae8e34e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:35.129506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1b7b0-268e-4ea9-a4c1-2e0a1ae8e34e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:35.130334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1b7b0-268e-4ea9-a4c1-2e0a1ae8e34e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:35.131891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1b7b0-268e-4ea9-a4c1-2e0a1ae8e34e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:35.214428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 479/955] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:21:35.426517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646164a3-f801-46b3-8704-d89a6aba78c9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:35.426862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646164a3-f801-46b3-8704-d89a6aba78c9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:35.427042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646164a3-f801-46b3-8704-d89a6aba78c9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:35.429678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 477/956] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:35.434998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:35.435294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:35.435581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:35.443195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:35.455823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:35.457906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:35.539120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 480/957] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:35.561883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646164a3-f801-46b3-8704-d89a6aba78c9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:35.671427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646164a3-f801-46b3-8704-d89a6aba78c9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:35.685353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:35.710244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:35.711290 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:35.711774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:35.712244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:35.713230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:35.714835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:35.724280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:35.726078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:35.726964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:35.730017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 478/958] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:35.740398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:35.847792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8b0a0-4c01-4cfd-861f-d5ee5389c961 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:35.878526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:35.885218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:35.886121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:35.886398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:35.886671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:35.887374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:35.887680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:35.889216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff24204-4107-4ce4-8c02-d4f22df84db7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:35.895131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 481/959] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:35.902022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:36.007539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d938688-dc57-4911-b2df-3a23f5c6f38f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:36.043803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:36.044422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:36.044705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:36.045007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:36.045680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:36.045986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:36.047351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730c29c-63f4-47a9-bd75-5dbebe4c07a3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:36.052831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 479/960] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:36.813331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063e25-3b18-4793-b999-c80bb0ef3ef4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:36.813824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063e25-3b18-4793-b999-c80bb0ef3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:36.813824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063e25-3b18-4793-b999-c80bb0ef3ef4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:36.815418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 482/961] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:36.820844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053a45c-f3c3-4e87-a796-d2bb470bc78c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:36.821132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053a45c-f3c3-4e87-a796-d2bb470bc78c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:36.821407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053a45c-f3c3-4e87-a796-d2bb470bc78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:36.840428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b053a45c-f3c3-4e87-a796-d2bb470bc78c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:36.841628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b053a45c-f3c3-4e87-a796-d2bb470bc78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:36.882675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:36.917689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 480/962] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:36.941482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063e25-3b18-4793-b999-c80bb0ef3ef4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.054722 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063e25-3b18-4793-b999-c80bb0ef3ef4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.093014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.093633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.093914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.094186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.094868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.096448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.129769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dd927-e03c-4c9d-be0a-1cec59375cab None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.130060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dd927-e03c-4c9d-be0a-1cec59375cab None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.130325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dd927-e03c-4c9d-be0a-1cec59375cab None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.131905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 481/963] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:37.136680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.136995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.137270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.148766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.sql.core [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 08:21:37.148766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 08:21:37.148766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [parameters: {'user_id': 'f73710a4416a4ee2aa92cd8b36d232d3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 08:21:37.148766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80326) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 08:21:37.155621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() Jul 27 08:21:37.156477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:21:37.157372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application yield resource Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise self.value Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application session.commit() Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 08:21:37.158345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.flush() Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application compat.raise_( Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 08:21:37.160142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:21:37.161921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:21:37.164673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f73710a4416a4ee2aa92cd8b36d232d3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:37.166589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 08:21:37.173261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 08:21:37.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 08:21:37.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 08:21:37.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 08:21:37.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 08:21:37.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 08:21:37.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.175553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:37.175691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 483/964] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Jul 27 08:21:36 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:37.175691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.245119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 482/965] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:37.260401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:37.265469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.312126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5cefc-5fe4-4069-9502-8cc333d819bd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.349448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.350173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.350454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.350828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.358261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.360075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.366680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:37.369741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd62176-ff85-4374-8a03-cf1adec3669a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e460ec51-87ee-4dc5-a9c4-afbd7ff5edeb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:37.373279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:37.374274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.375348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 484/966] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:37.376439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf706-8bed-4bf5-a530-8af69fba2070 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.376439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf706-8bed-4bf5-a530-8af69fba2070 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.376612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf706-8bed-4bf5-a530-8af69fba2070 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.382245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 485/967] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:37.382245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf706-8bed-4bf5-a530-8af69fba2070 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.414056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decadf6-b2b7-4393-82ac-a0bd507454e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.414690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decadf6-b2b7-4393-82ac-a0bd507454e7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.414967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decadf6-b2b7-4393-82ac-a0bd507454e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.415237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decadf6-b2b7-4393-82ac-a0bd507454e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.425772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decadf6-b2b7-4393-82ac-a0bd507454e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7decadf6-b2b7-4393-82ac-a0bd507454e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:37.431072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:37.432012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:37.433004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:37.436906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 483/968] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:37.438123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.438403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.438671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.456943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:37.458113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:37.497082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf706-8bed-4bf5-a530-8af69fba2070 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.515283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:37.533724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.534299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.534587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.534865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.540963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 484/969] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:37.541137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:37.541137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.541301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.541380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.578053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 486/970] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:37.578901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.652527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:37.666808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052b3f2-bb23-4cd5-92c5-607bea5fa11c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.709668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d98f-3dfb-451a-b8bf-9f962deb747d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.717140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.717787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.718073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.718351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.719085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:37.720176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.721647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.735157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 485/971] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:37.741486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.767010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.767658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.767976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.768213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.768879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.770249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:37.780138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:37.781252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:37.782096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:37.782856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 487/972] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:37.790442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.842204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:37.873366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d959ade-9727-467d-8dd3-fe3d92655dda None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.908972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.909544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.909819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.910090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.921413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.922477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a16a4c-476c-4556-aa75-04f9b35b00d5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:37.922858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:37.937868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:37.938795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:37.939706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:37.939706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:37.939706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:37.939706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:37.939706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 486/973] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:37.944589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:37.955746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:37.960594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:37.961249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:37.961534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:37.961806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:37.962475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:37.962777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:37.964151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:37.969096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 488/974] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:37.974534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.061530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b112-aedd-4c51-aaf8-248c35ac2291 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.081954 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ffbb1-97de-4453-9cf4-e97509880b7e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.083748 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:38.097767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.098389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.098675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.098954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.099638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:38.100548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.101958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.114653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 487/975] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:38.119923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.120179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.121120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.121637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.122125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.123011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:38.123535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.125204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.131492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 489/976] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:38.137468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.183544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:38.221302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23863f-3a51-4c63-96a4-31145bd46bc5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.240422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d86809-01f9-4e55-bb84-dbf77787e1d2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.256369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.257112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.257394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.257663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.264825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.266265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.274232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.274844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.275131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.275408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.276167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] RBAC: Adding query filter params (interface=admin, service_id=cb720191b08f4f5b932de8ad45ff7252, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:38.276481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.277847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545f507-356f-4346-93fa-8e0065455818 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-3553904e-98e0-41aa-b878-600c1c82f226 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:38.278201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:38.279094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:38.280468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 488/977] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:21:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:38.281220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0ec4-2a20-4263-b99d-bdd164569296 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.281220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0ec4-2a20-4263-b99d-bdd164569296 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.281220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0ec4-2a20-4263-b99d-bdd164569296 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.282616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 489/978] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:38.284393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 490/979] 10.222.0.60 () {56 vars in 1249 bytes} [Wed Jul 27 08:21:38 2022] GET /identity/v3/endpoints?service_id=cb720191b08f4f5b932de8ad45ff7252&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:38.287105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0ec4-2a20-4263-b99d-bdd164569296 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.290159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.290648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.290932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.309072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:38.310611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:38.334069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:38.376868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 491/980] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:38.377698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.390372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0ec4-2a20-4263-b99d-bdd164569296 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.414425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:38.424798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.428662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.428662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.428662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.428662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:38.428662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.429180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.446738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 490/981] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Jul 27 08:21:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:38.447455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.488834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff8700-4d69-4594-9fae-26513d734813 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.525867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.526493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.526779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.527054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.527714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.529106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.535015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 492/982] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:38 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:21:38.535791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.550510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512fff-0602-45b1-9e96-32a2ede36545 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.565942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:38.592353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.593030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.593316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.593590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.594309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.595811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.650617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b048f9-be3c-481a-816f-e46494055aa0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:38.689084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 491/983] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:38 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:38.696689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:38.697425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:38.698213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:38.698213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:38.777459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:38.778934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:38.802185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:38.889711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 493/984] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:38 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:38.896079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:38.940971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:39.000168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8b8e-73eb-44a7-8108-a110653df551 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:39.035745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:39.036393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:39.036672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:39.036968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:39.048681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:39.050153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:39.065193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:39.066137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:39.067700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:39.067700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:39.067700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:39.067700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:39.067700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 492/985] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:39.072090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:39.176785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f1f5f-d7ea-4838-93ff-b1d6dbad00d6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:39.197483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:39.212196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:39.212852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:39.213138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:39.213415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:39.214108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:39.214559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:39.215852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:39.232426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 494/986] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:39.233722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:39.330277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:39.338226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639f114-f10d-47a0-84c6-3166aafaaad7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:39.371727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:39.372366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:39.372648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:39.372950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:39.379458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:39.381444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:39.393017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:39.393924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:39.400697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 493/987] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:39.401433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:39.508048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910828-7ae4-4a9a-9d7e-d104cc58f518 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:39.545010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:39.545620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:39.545898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:39.546165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:39.546898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:39.547199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:39.548719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124b078-9c10-4566-ba72-c7e1992850ce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:39.561023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 495/988] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:39.566709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:39.667748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a99e9-18c5-4f59-aebf-066797a5ce60 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:39.702240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:39.702855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:39.703131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:39.703399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:39.704183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] RBAC: Adding query filter params (role.id=fefbc531a7ed46edbc4e45ebd033934e, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=832e2dbf7ce74ba6b43daf615a19a999) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:39.704538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:39.705993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021e2f-625e-4faa-a78d-9f9c6a9bef51 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:39.720847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 494/989] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:39 2022] GET /identity/v3/role_assignments?user.id=832e2dbf7ce74ba6b43daf615a19a999&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=fefbc531a7ed46edbc4e45ebd033934e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:40.593533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833023-0a7f-457d-bd87-c62d5a29faf1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:40.594047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833023-0a7f-457d-bd87-c62d5a29faf1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:40.594148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833023-0a7f-457d-bd87-c62d5a29faf1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:40.595478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 496/990] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:40.601177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9690-0208-4715-babb-d628ebebd825 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:40.601594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9690-0208-4715-babb-d628ebebd825 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:40.601761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9690-0208-4715-babb-d628ebebd825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:40.619655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a97f9690-0208-4715-babb-d628ebebd825 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:40.620873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a97f9690-0208-4715-babb-d628ebebd825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:40.633922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:40.688779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 495/991] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:40.711882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833023-0a7f-457d-bd87-c62d5a29faf1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:40.731158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba58577-7981-4928-8d84-8f8261dc2453 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:40.731469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba58577-7981-4928-8d84-8f8261dc2453 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:40.731719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba58577-7981-4928-8d84-8f8261dc2453 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:40.733189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 496/992] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:40.739485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:40.740112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:40.740449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:40.758946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:40.761309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:40.762489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:40.825004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833023-0a7f-457d-bd87-c62d5a29faf1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:40.832592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 497/993] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:40.855525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:40.867026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:40.867679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:40.867961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:40.868240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:40.868948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:40.870364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:40.880048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:40.881835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:40.882739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 497/994] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Jul 27 08:21:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:40.888240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:40.945002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:40.968016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701447a-bde0-4731-9a1a-d2b67e2ac1b4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:40.993011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085699e6-b9f7-4c50-8116-be95f8c0f06b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:40.996267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:41.004424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.005150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.005483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.005764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.006735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.008109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:41.017568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:41.018543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:41.019489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 498/995] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:41.026019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:41.033623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.034244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.034529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.034812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.035571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:41.035879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.037862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.043052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 498/996] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:41.048497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:41.139637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905bc0-4f63-499f-adaf-4349b3507db4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:41.153703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564b4d-a2fa-4479-9815-0b2bb7a346c5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:41.176095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.176709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.177018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.177288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.178209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:41.178612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.179984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.185010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 499/997] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:41.190683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:41.196405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.197066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.197351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.197622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.198295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:41.198600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.199944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.200148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:41.210443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 499/998] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Jul 27 08:21:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:41.211847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:41.244188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:41.301238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43e6b-60f0-44ba-b77c-c6ac5c6dc253 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:41.320015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6449ec-c20b-48d3-8702-b98cea275a68 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:41.339957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.340578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.340895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.341162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.341831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:41.342134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.343501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.348518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 500/999] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:41.354594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:41.357023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.357644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.357930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.358905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.358905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.360256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.424159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:41.435640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 500/1000] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:21:41.457824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be01fc-7fc7-4032-8574-04c1190265c9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:41.505695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.506372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.506653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.506925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.508838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] RBAC: Adding query filter params (interface=public, service_id=725272c4038d442d9978b1dc2a0de4dd, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:41.509465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.511387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7b20-b780-48c9-99b3-91bf71316cd4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.518352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 501/1001] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:41 2022] GET /identity/v3/endpoints?service_id=725272c4038d442d9978b1dc2a0de4dd&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:41.524534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:41.623988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:41.633426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea61ea-c014-49fe-848a-ff9e16c0ee6b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:41.669027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b82b6-9bdc-4791-82e9-e644db78a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:41.669651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b82b6-9bdc-4791-82e9-e644db78a75c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.669930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b82b6-9bdc-4791-82e9-e644db78a75c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.670203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b82b6-9bdc-4791-82e9-e644db78a75c None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.670852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b82b6-9bdc-4791-82e9-e644db78a75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:41.672205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b82b6-9bdc-4791-82e9-e644db78a75c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:41.684334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 501/1002] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:41 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:21:41.745917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17201-4179-4142-983a-7c8454e50b69 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.746485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17201-4179-4142-983a-7c8454e50b69 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.746485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17201-4179-4142-983a-7c8454e50b69 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.748016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 502/1003] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:41.753453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:41.753762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:41.754000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:41.810648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:41.811859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:41.890499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 502/1004] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:41.913260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17201-4179-4142-983a-7c8454e50b69 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:42.019340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17201-4179-4142-983a-7c8454e50b69 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:42.049493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:42.056050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:42.056585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:42.056887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:42.062477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] PATH_INFO: `/v3/services/image` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:42.062477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:42.062477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:42.068050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:42.069403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:42.070241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 503/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Jul 27 08:21:41 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:42.077407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:42.165400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:42.180423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ff81e-8dc2-4b8e-a12f-779b5b1792d4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:42.215264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:42.215888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:42.216168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:42.216441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:42.217145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:42.217449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:42.218797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26083a35-c704-41e9-8d0b-f106d974b2e2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:42.228406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 503/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:42.229916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:42.331976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6254f-2ecf-4303-9e94-1d45251b3e25 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:42.365629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:42.366238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:42.366516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:42.366783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:42.367441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] RBAC: Adding query filter params (type=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:42.367765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:42.369203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd0cd1-3ecc-4195-ab7e-9a81b08759bf None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:42.373908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 504/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:43.503822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb0bf-575a-4230-90cd-875aaa58721a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:43.504362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb0bf-575a-4230-90cd-875aaa58721a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:43.504362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb0bf-575a-4230-90cd-875aaa58721a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:43.505988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 504/1008] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:43.512165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4f5c6-c35c-425e-bc2a-abcc348e4285 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:43.512946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4f5c6-c35c-425e-bc2a-abcc348e4285 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:43.513388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4f5c6-c35c-425e-bc2a-abcc348e4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:43.532559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0aa4f5c6-c35c-425e-bc2a-abcc348e4285 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:43.533768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0aa4f5c6-c35c-425e-bc2a-abcc348e4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:43.590044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:43.604370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 505/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:43.626995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb0bf-575a-4230-90cd-875aaa58721a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:43.725242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdba59d-5b2a-42f3-a63c-4afcb6c9d143 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:43.725566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdba59d-5b2a-42f3-a63c-4afcb6c9d143 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:43.725791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdba59d-5b2a-42f3-a63c-4afcb6c9d143 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:43.727153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 506/1010] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:43.732539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:43.732873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:43.733254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:43.733556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb0bf-575a-4230-90cd-875aaa58721a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:43.753517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:43.755281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:43.778015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:43.779073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:43.779569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:43.780044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:43.782092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:43.783542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:43.785169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 505/1011] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:43.791928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:43.814324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:43.852704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 507/1012] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:43.878304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:43.908287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9230b-1f56-4801-87f7-84e1197461cf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:43.945886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:43.946562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:43.947085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:43.947085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:43.948299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:43.949995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:43.989696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d19b6b-5871-4904-b3d4-d6d83815faa5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:44.008162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:44.025455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:44.026104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.026506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.026878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.027617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:44.029096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:44.040217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 506/1013] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:43 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:44.040409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:44.041631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:44.042481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 508/1014] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:44.046091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:44.125096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:44.160055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322e22-4434-424f-8bb1-03a109580f6c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:44.199323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:44.199949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.200231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.200508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.201210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:44.202036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:44.202863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80072-0839-445d-821c-719a56444ae2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:44.208386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 507/1015] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:44.214807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:44.328300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca65458-0d29-4113-b6a0-b399ec7745b3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:44.363514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:44.364195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.364483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.364780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.366110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:44.366414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:44.367788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:44.372845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7dd5a-051b-46ec-bb12-081c20eae15a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.373188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7dd5a-051b-46ec-bb12-081c20eae15a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.373411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 509/1016] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Jul 27 08:21:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:44.373528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7dd5a-051b-46ec-bb12-081c20eae15a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.374788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 508/1017] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:44.378534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:44.380062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.380420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.381479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.400793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:44.402101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:44.435044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:44.473226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 509/1018] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:44 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:44.493922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999816a2-04d6-46e3-ad6d-b6f8a18f77e5 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:44.495967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:44.531689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8f90-270d-4eec-bae6-16ff84401720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:44.532316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8f90-270d-4eec-bae6-16ff84401720 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.532600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8f90-270d-4eec-bae6-16ff84401720 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.532916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8f90-270d-4eec-bae6-16ff84401720 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.533641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe8f90-270d-4eec-bae6-16ff84401720 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:44.535013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe8f90-270d-4eec-bae6-16ff84401720 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:44.568691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:44.607846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81c821-b348-4659-8fe2-a789c2f944e3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:44.610713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 510/1019] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:44.659279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce53f6-573c-449a-b567-0d7bb1b11f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:44.659920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce53f6-573c-449a-b567-0d7bb1b11f34 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:44.660204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce53f6-573c-449a-b567-0d7bb1b11f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:44.660479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce53f6-573c-449a-b567-0d7bb1b11f34 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:44.661222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce53f6-573c-449a-b567-0d7bb1b11f34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:44.663405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce53f6-573c-449a-b567-0d7bb1b11f34 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:44.765405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 510/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:21:44 2022] POST /identity/v3/services => generated 242 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:21:46.101764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeafe1-e31b-4ccf-9f8c-82d11a48fdb9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.102333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeafe1-e31b-4ccf-9f8c-82d11a48fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.102333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeafe1-e31b-4ccf-9f8c-82d11a48fdb9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.104767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 511/1021] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:46.108879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.109296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.109474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.127318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:46.128502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:46.202641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 511/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:46.227729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeafe1-e31b-4ccf-9f8c-82d11a48fdb9 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:46.329275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeafe1-e31b-4ccf-9f8c-82d11a48fdb9 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:46.330840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:46.363506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c620d-362e-480f-bbeb-bce562355765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:46.363506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c620d-362e-480f-bbeb-bce562355765 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.363506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c620d-362e-480f-bbeb-bce562355765 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.363835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c620d-362e-480f-bbeb-bce562355765 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.365574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c620d-362e-480f-bbeb-bce562355765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:46.367023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c620d-362e-480f-bbeb-bce562355765 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:46.372959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 512/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:46.374982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:46.422871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:46.477926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73e41-2439-4386-a3cf-acb97ec5146f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:46.520670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d8f1-fdca-4db7-9dcc-31899231b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:46.522170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d8f1-fdca-4db7-9dcc-31899231b04a None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.522541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d8f1-fdca-4db7-9dcc-31899231b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.522829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d8f1-fdca-4db7-9dcc-31899231b04a None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.523549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d8f1-fdca-4db7-9dcc-31899231b04a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:46.525003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d8f1-fdca-4db7-9dcc-31899231b04a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:46.638752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 512/1024] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:21:46 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:21:46.777329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87418b-9401-4a5f-be7a-cfad54e41a04 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.777695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87418b-9401-4a5f-be7a-cfad54e41a04 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.777897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87418b-9401-4a5f-be7a-cfad54e41a04 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.779426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 513/1025] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:46.784774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.785070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.785354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.804783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:46.805989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:46.818905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116020-5493-44cd-b308-bd6a68b1c9e9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.819194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116020-5493-44cd-b308-bd6a68b1c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.819468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116020-5493-44cd-b308-bd6a68b1c9e9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.820849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 514/1026] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:46.825850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:46.826141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:46.826427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:46.844675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:46.845901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:46.888053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 513/1027] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:46.911232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:46.922049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 515/1028] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:46.945197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:46.945990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.023252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fec2f7-9bcd-4eac-be24-d39e5a52fda0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.049991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.053396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef75007-b6d2-41ed-b0ce-8f84c725ef5a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.062685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.063704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.063993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.064274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.076353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:47.081845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:47.082814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:47.084241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 514/1029] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Jul 27 08:21:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:47.089605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.091332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.091982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.092263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.092645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] PATH_INFO: `/v3/services/image` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.093190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.094557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:47.104160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:47.105615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:47.106479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:47.110466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 516/1030] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Jul 27 08:21:46 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:47.111514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.196034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.205506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed7244-f03b-4965-96aa-78824fb1c66e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.214136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c46b-b670-42d5-be7c-e451e097a91c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.246307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.247018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.247415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.247783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.248587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:47.248991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.249781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.250368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.250467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.250657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.250926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.251583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] RBAC: Adding query filter params (name=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:47.251890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.253267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.263948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 517/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:47.264487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 515/1032] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:47.265508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.265620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.299081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.371191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8128d3c-884e-4276-986c-398fc970aaf8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.378321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1ffa-efa8-4149-b1f9-0de59cc82d9c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.410394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.411011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.411298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.411574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.412968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] RBAC: Adding query filter params (type=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:47.413276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.414645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.417034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.417902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.418402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.418900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.419434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 516/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:47.425185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.434128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.435957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.444218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:47.453635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:47.454548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:47.455456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:47.455456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:47.455456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:47.455456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:47.462333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 518/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:47.463651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.535307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc68c1-1b3e-42da-8a50-af883ae2adfa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.551819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.571176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.571379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3a055-8828-4ed0-b814-c33b4ad0c7d7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.571801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.572088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.572366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.573162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] RBAC: Adding query filter params (interface=public, service_id=aba68b4a4a2447ecaa4a77955fe88116, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:47.573484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.574847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.580451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 517/1035] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/endpoints?service_id=aba68b4a4a2447ecaa4a77955fe88116&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:47.586146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.607617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.608243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.608528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.608835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.609524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:47.609830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.611204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.623259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 519/1036] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:47.628573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.680205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.698753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa60bf2-17ab-42cd-8ae0-f23c537dc7d3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.733124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.733741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.734021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.734316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.734934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb2fdc-c82f-4234-816c-03a302cc6d34 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.735039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.736311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.743325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 518/1037] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:21:47.775504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.776178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.776461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.776766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.785293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.787446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.790636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:47.801827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:47.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:47.810640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 520/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:47.811514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:47.922962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537d9be-1a06-4d47-a843-3e9755bd08ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:47.957092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:47.957711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:47.957988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:47.958258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:47.959570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:47.959873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:47.961297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:47.983669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 519/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:47.985487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:48.084916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d904a0-7d69-4460-9771-938947e35128 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:48.118139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:48.118789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.119022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.119287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.185047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:48.187963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:48.189445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:48.295901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 521/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:47 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:48.297439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:48.301696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:48.399643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f86af-b1f0-444d-840c-a319edcc0be6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:48.433348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:48.433997 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.434279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.434551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.445434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:48.446885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:48.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:48.463473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:48.464367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:48.464367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:48.464367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:48.464367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:48.468638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 520/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:48.470033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:48.575205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:48.578192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57349e5-fbef-4b6e-9db0-b2a0eb11f8ec None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:48.613233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:48.613854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.614135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.614406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.615109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:48.615415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:48.616794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7e28-22d1-4bce-a24c-3b6516ddbb77 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:48.628065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 522/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:48.633491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:48.690078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:48.735649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e6d20-7cc7-4ffe-9c32-7eaf2152be87 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:48.739774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6bcac-569e-4b4c-9a35-3fe08f16f28a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.740068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6bcac-569e-4b4c-9a35-3fe08f16f28a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.740346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6bcac-569e-4b4c-9a35-3fe08f16f28a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.741988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 523/1043] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:48.748295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.748579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.748964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.767334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:48.768606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:48.778527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:48.779720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.780442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.780929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.788887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:48.790491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:48.802073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:48.803307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:48.804211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 521/1044] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:48.808956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:48.846710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 524/1045] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:48.870702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:48.921528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33b02f-329a-485c-a95a-e04fe21705f6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:48.938271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:48.956901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:48.957522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:48.957869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:48.958154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:48.959525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:48.959836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:48.961287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:48.968177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:48.974417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 522/1046] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:48.978433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1208e-0fcc-4136-b56a-ca2d8af831ec None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:48.980136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.018389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:49.019096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.019379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.019656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.033331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:49.038308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:49.039251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:49.040133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 525/1047] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:49.046165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.089879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25d52-36c3-4544-a1aa-eca47ab76b91 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:49.126030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:49.126915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.127360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.127887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.128850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] RBAC: Adding query filter params (role.id=fefbc531a7ed46edbc4e45ebd033934e, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=bb119ceb349f429aacde98d2940dde47) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:49.129326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:49.131127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:49.137172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 523/1048] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:48 2022] GET /identity/v3/role_assignments?user.id=bb119ceb349f429aacde98d2940dde47&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=fefbc531a7ed46edbc4e45ebd033934e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:49.159739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c329db-2396-4ef3-87d9-7510c903e7e6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:49.199291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:49.199930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.200213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.200495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.201258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:49.201570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:49.202979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:49.218475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 526/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:49.220194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.275478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:49.336962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9428f-58f8-4635-b063-7390367e5e0c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:49.373052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:49.373701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.373984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.374262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] PATH_INFO: `/v3/users/8e804e4f2be0453989c8fd3cf8e7b197` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.388941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] RBAC: Authorizing `identity:get_user(user_id=8e804e4f2be0453989c8fd3cf8e7b197)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:49.390309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:49.392141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 524/1050] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:21:49 2022] GET /identity/v3/users/8e804e4f2be0453989c8fd3cf8e7b197 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:49.398455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.413955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:49.511103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a7fb-0ab8-45fb-9040-fcb92b46e5c6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:49.546680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e0107-0b87-480e-900c-9fcc34b8f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:49.547302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e0107-0b87-480e-900c-9fcc34b8f23e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.547589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e0107-0b87-480e-900c-9fcc34b8f23e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.547866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e0107-0b87-480e-900c-9fcc34b8f23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.615797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e0107-0b87-480e-900c-9fcc34b8f23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:49.617289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e0107-0b87-480e-900c-9fcc34b8f23e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:49.630902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:49.722985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 527/1051] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:49.725267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.762840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2c5d-20b0-4967-a366-6cfd95ac9947 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.763129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2c5d-20b0-4967-a366-6cfd95ac9947 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.763409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2c5d-20b0-4967-a366-6cfd95ac9947 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.765566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 528/1052] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:49.769868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.770155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.770428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.789370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:49.790562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:49.833144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:49.837371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605781f3-fff9-46fe-a6bc-c112b5f233ce None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:49.866296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 529/1053] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:49.873442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:49.874487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:49.875111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:49.875585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:49.877208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] RBAC: Authorizing `identity:get_project(project_id=4f71780a4bea442195d2f0f30a0ff390)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:49.878673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:49.881092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 525/1054] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:21:49 2022] GET /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:49.887280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.893167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:49.936654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:49.994464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff12883-827c-4dce-ae8e-c2999e9bc005 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:50.000713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ea28-4cf0-496a-80c1-05a4d46de924 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:50.029664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:50.030303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:50.030591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:50.030874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] PATH_INFO: `/v3/services/image` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:50.031485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:50.032883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:50.039413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:50.040233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:50.040697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:50.041205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:50.042189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:50.043135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:21:50.043990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:50.044751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=4f71780a4bea442195d2f0f30a0ff390, user.id=8e804e4f2be0453989c8fd3cf8e7b197) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:50.044829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 526/1055] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Jul 27 08:21:49 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:50.044914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:50.045496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:50.049260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:50.061022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 530/1056] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:49 2022] GET /identity/v3/role_assignments?user.id=8e804e4f2be0453989c8fd3cf8e7b197&scope.project.id=4f71780a4bea442195d2f0f30a0ff390&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:50.082213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:50.156856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153db61-1b06-4d85-bbc9-0622a13cf18e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:50.193833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:50.194466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:50.194749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:50.195025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:50.195710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:50.196014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:50.197427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:50.203049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 527/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:50.210256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:50.314884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132a023-f8ae-48cd-9f49-7fa9ed9a3adc None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:50.323491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:50.350161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:50.351176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:50.351682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:50.352225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:50.353141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] RBAC: Adding query filter params (type=image) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:50.353649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:50.355211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557a55b-35ba-4341-bb4e-7048b1db3c46 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:50.360407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 531/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:50.367276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:50.462570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:50.469397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45299fcd-cfbc-418a-b047-a3012c871ed7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:50.510302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f37d-90c5-442d-be0a-84678dfdb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:50.510302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f37d-90c5-442d-be0a-84678dfdb07a None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:50.510302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f37d-90c5-442d-be0a-84678dfdb07a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:50.510302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f37d-90c5-442d-be0a-84678dfdb07a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:50.511877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f37d-90c5-442d-be0a-84678dfdb07a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:50.512672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f37d-90c5-442d-be0a-84678dfdb07a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:50.640837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 528/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:21:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:21:51.155597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e0c1-fe49-44d3-b732-ea14542e17fa None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:51.155945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e0c1-fe49-44d3-b732-ea14542e17fa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:51.156153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e0c1-fe49-44d3-b732-ea14542e17fa None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:51.157596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 532/1060] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:51.163927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:51.164221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:51.164699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:51.184187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:51.185400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:51.259042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 529/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:51.282063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e0c1-fe49-44d3-b732-ea14542e17fa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:51.383860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e0c1-fe49-44d3-b732-ea14542e17fa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:51.418748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:51.419309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:51.419591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:51.419867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:51.429886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:51.434711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:51.435649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:51.436491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:51.440916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 533/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Jul 27 08:21:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:51.441742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:51.523097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:51.545169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1e405-3263-4a51-bd17-f2f18d2a8bdf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:51.578413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:51.579034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:51.579317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:51.579592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:51.580305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:51.580612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:51.581997 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:51.590856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 530/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:21:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:51.596396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:51.628310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:51.700066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758387f-80ee-435b-8bed-b13afb601d0e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:51.736162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:51.736845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:51.737136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:51.737412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:51.749005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:51.750503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:51.768305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:51.769562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:51.771557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:51.771557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:51.771557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:51.771557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:51.771557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 534/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:51.777986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:51.878697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0533-9b87-471f-b5e2-c0e002c059c0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:51.913203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:51.913819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:51.914096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:51.914369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:51.915048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:51.915350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:51.916694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bec635-2fbf-411e-831c-244de82f679d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:51.923540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:51.932825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 531/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:51.935621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.017024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.035213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796a18a-803d-4594-b92f-53440b112d5e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.069176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.069874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.070165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.070426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.074862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d16f9-6e5c-4cdb-b107-04633a46d1a0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.074862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d16f9-6e5c-4cdb-b107-04633a46d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.074862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d16f9-6e5c-4cdb-b107-04633a46d1a0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.076795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 532/1066] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:52.078132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.079570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.081616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.081902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.082187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:52.091458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:52.092451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 535/1067] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:52.098540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.107058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:52.108241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:52.180322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 533/1068] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:52.202339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.205473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0fc3-d743-4e22-b428-859d213ed7e3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.240272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.240920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.241200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.241470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.242254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:52.242558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.243982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.259767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.264230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 536/1069] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:52.272759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.316943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992c276-5b55-4ab0-b77c-59c95b7d923b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.347420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.357353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:52.388178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:52.388897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:52.389732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 534/1070] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:52.390598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.391030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2108c89-7e2d-4dc5-b73c-cb53bf6c89b6 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.424312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.424982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.425269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.425555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.435825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.437308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:52.451935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:52.452895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:52.453870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:52.453870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:52.453870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:52.453870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:52.453870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 537/1071] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:52.459460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.494500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f4904-3142-46ad-8bc7-39a7536ecd52 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.514793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.538600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.539136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.539416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.539687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.540409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:52.540713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.542094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.550808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 535/1072] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:52.556807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.574954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6d113-0ee4-4371-a72e-7db77c66c918 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.611803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.613042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.613637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.613920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.614195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.615140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:52.615442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.616838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.628928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 538/1073] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:52.635492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.674473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f381e-93f6-4c79-b112-07fa6f74d40f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.712101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702509a-5112-4914-b8b2-635a3fe3e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.712751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702509a-5112-4914-b8b2-635a3fe3e275 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.713036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702509a-5112-4914-b8b2-635a3fe3e275 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.713308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702509a-5112-4914-b8b2-635a3fe3e275 None admin] PATH_INFO: `/v3/users/8e804e4f2be0453989c8fd3cf8e7b197` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.714488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702509a-5112-4914-b8b2-635a3fe3e275 None admin] RBAC: Authorizing `identity:get_user(user_id=8e804e4f2be0453989c8fd3cf8e7b197)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.715902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702509a-5112-4914-b8b2-635a3fe3e275 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.717517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 536/1074] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/users/8e804e4f2be0453989c8fd3cf8e7b197 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:52.718631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603498-3edd-4088-bbb8-23eda7479948 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.718910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603498-3edd-4088-bbb8-23eda7479948 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.719178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603498-3edd-4088-bbb8-23eda7479948 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.720370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 537/1075] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:52.722974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603498-3edd-4088-bbb8-23eda7479948 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.745697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317ccb7-dcce-40e2-a81e-460f93e8f422 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.759576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.780670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.781336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.781614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.781887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.788552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.790154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-9356d9fa-7616-4d66-bd83-426be1094210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:52.801606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:52.807545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 539/1076] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.808776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.809550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.858809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:52.859999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:52.878169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603498-3edd-4088-bbb8-23eda7479948 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:52.897352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:52.914135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:52.914777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:52.915061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:52.915337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:52.916493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] RBAC: Authorizing `identity:get_project(project_id=4f71780a4bea442195d2f0f30a0ff390)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:52.917956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:52.919782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 538/1077] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:52.920403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:52.931318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 540/1078] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:52.932137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:53.024300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bc55-cc78-43c5-a519-262e1dd99fdf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:53.043603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc1ddc-4889-4eb8-9a34-7c8d7e2936d5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:53.045048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:53.058501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:53.059109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:53.059392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:53.059668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:53.060411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:53.060716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:53.062146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:53.074064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 539/1079] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:53.074860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:53.077415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:53.078090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:53.078375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:53.078648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390/users/8e804e4f2be0453989c8fd3cf8e7b197/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:53.080928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f71780a4bea442195d2f0f30a0ff390, user_id=8e804e4f2be0453989c8fd3cf8e7b197, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:53.082759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:53.120431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:53.153675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 541/1080] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:52 2022] PUT /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390/users/8e804e4f2be0453989c8fd3cf8e7b197/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:21:53.154469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:53.173303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb05f-6f2e-4855-87a3-cf0ae0e50c7b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:53.214342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:53.214986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:53.215269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:53.215548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:53.290508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765ae24-179d-4500-81da-c0443a4d6615 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:53.295411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:53.296916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:53.332477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:53.333247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:53.333531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:53.333809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/bb119ceb349f429aacde98d2940dde47/roles/fefbc531a7ed46edbc4e45ebd033934e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:53.336062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=bb119ceb349f429aacde98d2940dde47, role_id=fefbc531a7ed46edbc4e45ebd033934e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:53.337621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:53.346750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:53.400753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 540/1081] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:53.406021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 542/1082] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:21:53 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/bb119ceb349f429aacde98d2940dde47/roles/fefbc531a7ed46edbc4e45ebd033934e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:21:53.406682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:53.535602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b57ad-e180-497c-aac7-1f9c831d5319 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:53.586265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:53.586853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:53.587142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:53.587423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:53.601384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:53.602863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:53.613285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8af8eb0b-cafe-4d4d-8bb2-d33a6dd3ca79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:53.622032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:53.622932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:53.623811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:53.623811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:53.623811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:53.623811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:53.623811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 541/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:53.635542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:53.667441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:53.743159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae85aa9-0828-4108-8b2a-59dbdaab2748 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:53.779226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:53.779860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:53.780144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:53.780421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:53.781392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:53.781964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:53.783849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea18938-2072-457c-8c69-3328517a1d21 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:53.799261 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 543/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:55.204127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb14ac-3c41-4965-ba67-2b76016246ce None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.204697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb14ac-3c41-4965-ba67-2b76016246ce None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.204697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb14ac-3c41-4965-ba67-2b76016246ce None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.206256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 542/1085] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:55.211637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acdd03-b755-42e2-b791-7e45a631d837 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.212039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acdd03-b755-42e2-b791-7e45a631d837 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.212183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acdd03-b755-42e2-b791-7e45a631d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.230530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d3acdd03-b755-42e2-b791-7e45a631d837 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:55.231718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d3acdd03-b755-42e2-b791-7e45a631d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:55.295882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 544/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:55.319830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb14ac-3c41-4965-ba67-2b76016246ce None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.421178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb14ac-3c41-4965-ba67-2b76016246ce None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.438955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbd9f1-98bc-4040-a76d-ccbb21a1f5ad None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.439252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbd9f1-98bc-4040-a76d-ccbb21a1f5ad None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.439532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbd9f1-98bc-4040-a76d-ccbb21a1f5ad None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.440917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 545/1087] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:21:55.445881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.446164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.446441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.455725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:55.456297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.456579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.456893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.464661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:55.465888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:55.467568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:55.472413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:55.473425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:21:55.474818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:21:55.475455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:55.475526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 543/1088] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:55.480025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.538299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:55.539782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 546/1089] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:21:55.563142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.578607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bada4e8-2f7a-44db-bff8-27fd2a946f19 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.612571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:55.613217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.613503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.613781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.614953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:55.615283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:55.616638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:55.624929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 544/1090] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:55.630575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.659997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34533cb-289e-43df-b0f7-df0bd591926c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.694580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:55.695211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.695488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.695757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.706504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:21:55.711910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:55.712920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:55.713779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 547/1091] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:55.718967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.722100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:55.733541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c99d4-ffa6-4d99-92f9-cb5b23a6ffd5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.753403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:55.767924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:55.775334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.775334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.775334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] PATH_INFO: `/v3/users/8e804e4f2be0453989c8fd3cf8e7b197` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.775334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] RBAC: Authorizing `identity:get_user(user_id=8e804e4f2be0453989c8fd3cf8e7b197)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:55.775334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:55.775334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 545/1092] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/users/8e804e4f2be0453989c8fd3cf8e7b197 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:55.779929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.819004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516902b9-2d5d-4b3c-892e-bd209ed66a18 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.853182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:55.853785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.854062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.854332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.855038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:55.855339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:55.856697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:55.864918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 548/1093] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:55.870531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:55.882832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ea04-9b01-4d1f-8ee0-809acec0451a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.918121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:55.918743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:55.919030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:55.919310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:55.930264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:55.968460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38460e-0a7d-4027-bd4b-c0cbc888fc13 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:55.974267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:55.986277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:55.987818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.001345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.001992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.002270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.002548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.014156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.015596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:56.030608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:56.031521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:56.032396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:56.032396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:56.032396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:56.032396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:56.032396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 549/1094] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:56.038070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.086782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 546/1095] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:21:56.092775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.136389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a26b6-dfaa-4565-9ae4-3456e285ef9e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.152337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:56.170355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.170967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.171249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.171523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.172206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:56.172510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.173909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.179150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:56.185819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 550/1096] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:56.191102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52bf74-9600-4649-b8d1-acb2fd340161 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.191433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.225995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.226558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.226843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.227121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.228278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4f71780a4bea442195d2f0f30a0ff390)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.229734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.231402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 547/1097] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:56.237753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.289596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701286-70de-4a7d-ba6c-006d7c5f174a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.323032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.323667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.323951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.324225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.331154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.332597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.337056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390624-478c-4cd2-b75a-3da42b70e7b8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:21:56.344486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:56.345572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:56.346830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 551/1098] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:56.351949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.372651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.373294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.373579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.373855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.374637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=4f71780a4bea442195d2f0f30a0ff390, user.id=8e804e4f2be0453989c8fd3cf8e7b197) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:56.374948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.376363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.382345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 548/1099] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/role_assignments?user.id=8e804e4f2be0453989c8fd3cf8e7b197&scope.project.id=4f71780a4bea442195d2f0f30a0ff390&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:56.385342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:56.454042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda6662-580a-420d-a93c-7a56df8d15d1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.489489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.490119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.490397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.490665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.491472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:56.491776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.493263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.514570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 552/1100] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:56.520393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.543726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:56.620387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c458-fe40-4e12-bbdd-607886599030 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.655130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.655753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.656073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.656400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.723759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.725259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.745937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:56.822085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 549/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:21:56.828429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:56.920173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:56.927186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a5b6-c369-4168-8430-fbec2a4a1fed None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:56.960600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:56.961267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:56.961548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:56.961819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:56.971625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:56.973101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:21:56.987613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:56.988699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:56.990514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:21:56.990514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:21:56.990514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:21:56.990514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:56.990514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 553/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:21:56.995326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:57.093160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b40a85-d4db-4f15-b5f3-09599de4354d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:57.112430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:57.126636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:57.127255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:57.127542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:57.127817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:57.128511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:57.128882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:57.130840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:57.143369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 550/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:57.148861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:57.245011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca1bb3-5a0c-4eea-bf1e-f85eb05ac629 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:57.276791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:57.277413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:57.277693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:57.277964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:57.284322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:57.285789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:21:57.297326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:21:57.298725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:21:57.299612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 554/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:21:57.305271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:57.401314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8b00-cd5b-4c8b-95c9-240873723af1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:57.436314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:57.436948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:57.437229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:57.437499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:57.438235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:57.438542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:57.439941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a36d0-f93e-439d-88ac-38ad53040832 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:57.451126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 551/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:21:57.457460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:57.466769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:57.560611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276153ec-5866-4cb8-904b-d4b8ed9c1b79 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:57.592972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:57.593581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:57.593862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:57.594134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:57.594906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] RBAC: Adding query filter params (role.id=fefbc531a7ed46edbc4e45ebd033934e, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=bb119ceb349f429aacde98d2940dde47) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:21:57.595212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:57.596634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff896-dcba-4b27-9313-3f5e58e09e13 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:57.602856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 555/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:21:57 2022] GET /identity/v3/role_assignments?user.id=bb119ceb349f429aacde98d2940dde47&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=fefbc531a7ed46edbc4e45ebd033934e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:58.403153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e525c-5307-4a76-8c4c-d394a7d5713a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:58.403697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e525c-5307-4a76-8c4c-d394a7d5713a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:58.403795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e525c-5307-4a76-8c4c-d394a7d5713a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:58.405263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 552/1107] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:21:58.410550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b647c-c433-4774-9821-f0336d3357ed None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:58.410966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b647c-c433-4774-9821-f0336d3357ed None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:58.411705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b647c-c433-4774-9821-f0336d3357ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:58.429368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-150b647c-c433-4774-9821-f0336d3357ed None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:21:58.430547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-150b647c-c433-4774-9821-f0336d3357ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:21:58.490220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:58.494629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 556/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:21:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:21:58.518988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e525c-5307-4a76-8c4c-d394a7d5713a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:58.569560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:21:58.635291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e525c-5307-4a76-8c4c-d394a7d5713a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:58.668176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14568693-eeba-4818-b608-e7ecdb4817e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:58.668776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14568693-eeba-4818-b608-e7ecdb4817e2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:58.669064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14568693-eeba-4818-b608-e7ecdb4817e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:58.669342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14568693-eeba-4818-b608-e7ecdb4817e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:58.670471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14568693-eeba-4818-b608-e7ecdb4817e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:58.671939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14568693-eeba-4818-b608-e7ecdb4817e2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:58.673545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 553/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:21:58.679434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b647c-c433-4774-9821-f0336d3357ed None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:21:58.775723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b647c-c433-4774-9821-f0336d3357ed None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:21:58.807967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926a2a-c094-446c-8529-0c718c1d5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:21:58.808571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926a2a-c094-446c-8529-0c718c1d5697 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:21:58.808882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926a2a-c094-446c-8529-0c718c1d5697 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:21:58.809158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926a2a-c094-446c-8529-0c718c1d5697 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:21:58.809838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52926a2a-c094-446c-8529-0c718c1d5697 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:21:58.811287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52926a2a-c094-446c-8529-0c718c1d5697 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:21:58.911031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 557/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:21:58 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:22:00.929519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709cf0-c029-4bab-b2d3-7ce0eddcfe03 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:00.930034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709cf0-c029-4bab-b2d3-7ce0eddcfe03 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:00.930034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709cf0-c029-4bab-b2d3-7ce0eddcfe03 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:00.931331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 554/1111] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:00.936392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:00.936801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:00.937046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:00.955294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:00.956587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:01.005346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:01.022352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 558/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:01.045234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709cf0-c029-4bab-b2d3-7ce0eddcfe03 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:01.143059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709cf0-c029-4bab-b2d3-7ce0eddcfe03 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:01.152614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:01.175945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:01.176636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:01.177067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:01.177350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] PATH_INFO: `/v3/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:01.178823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] RBAC: Authorizing `identity:get_role(role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:01.180231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:01.181530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 555/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:01 2022] GET /identity/v3/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:01.187542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:01.283830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2ab59-9edf-4352-9b5c-3a34c86d71f4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:01.316611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:01.317937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:01.318221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:01.318496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] PATH_INFO: `/v3/users/a4511cdb1d2f4ff687e25af4014b22a3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:01.331044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] RBAC: Authorizing `identity:get_user(user_id=a4511cdb1d2f4ff687e25af4014b22a3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:01.332486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:01.334114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 559/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:01 2022] GET /identity/v3/users/a4511cdb1d2f4ff687e25af4014b22a3 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:01.339957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:01.435963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e0c3a-5f02-4021-b4bd-c852363f7b42 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:01.469511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:01.470112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:01.470397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:01.470675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:01.514263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:01.537161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:01.538605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:01.633051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 556/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:01.639189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:01.683081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:01.735222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26befea3-2510-4d15-b691-0a395f213794 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:01.768006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca91f8-8932-4186-9a0d-a87a09e4da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:01.768634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca91f8-8932-4186-9a0d-a87a09e4da1b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:01.768937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca91f8-8932-4186-9a0d-a87a09e4da1b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:01.769213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca91f8-8932-4186-9a0d-a87a09e4da1b None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:01.771162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca91f8-8932-4186-9a0d-a87a09e4da1b None admin] RBAC: Authorizing `identity:get_project(project_id=4f71780a4bea442195d2f0f30a0ff390)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:01.772646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca91f8-8932-4186-9a0d-a87a09e4da1b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:01.774318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 560/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:01 2022] GET /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:01.780532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:01.854332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:01.875885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5854222-f7f4-4743-b312-b3692f02826f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:01.911121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:01.911729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:01.912013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:01.912288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:01.913093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] RBAC: Adding query filter params (role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=4f71780a4bea442195d2f0f30a0ff390, user.id=a4511cdb1d2f4ff687e25af4014b22a3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:01.913405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:01.914834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbed2e5-56e8-4396-b298-dd3cafdb42ac None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:01.920161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 557/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:22:01 2022] GET /identity/v3/role_assignments?user.id=a4511cdb1d2f4ff687e25af4014b22a3&scope.project.id=4f71780a4bea442195d2f0f30a0ff390&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:03.899060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52c5a-b537-4a32-bfca-165b83d55d2c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:03.899563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52c5a-b537-4a32-bfca-165b83d55d2c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:03.899563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f52c5a-b537-4a32-bfca-165b83d55d2c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:03.900912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 561/1118] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:03.906097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:03.906494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:03.906660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:03.925062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:03.926258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:03.990906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 558/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:04.014010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52c5a-b537-4a32-bfca-165b83d55d2c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:04.111404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f52c5a-b537-4a32-bfca-165b83d55d2c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:04.124063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:04.144401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:04.145645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:04.145946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:04.146221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] PATH_INFO: `/v3/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:04.147634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] RBAC: Authorizing `identity:get_role(role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:04.149023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:04.150385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 562/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:04 2022] GET /identity/v3/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:04.156182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:04.222258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:04.251115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a8fc-fb01-449b-aa65-665e785a316e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:04.284875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:04.285508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:04.285828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:04.286092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] PATH_INFO: `/v3/users/a4511cdb1d2f4ff687e25af4014b22a3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:04.287251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] RBAC: Authorizing `identity:get_user(user_id=a4511cdb1d2f4ff687e25af4014b22a3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:04.288678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:04.290341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 559/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:04 2022] GET /identity/v3/users/a4511cdb1d2f4ff687e25af4014b22a3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:04.296027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:04.393610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a7713-82c6-4f16-9180-b638e5c0b28f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:04.425371 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c863e-9480-4494-89fc-4ed484ee2c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:04.425944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c863e-9480-4494-89fc-4ed484ee2c6e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:04.426728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c863e-9480-4494-89fc-4ed484ee2c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:04.427001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c863e-9480-4494-89fc-4ed484ee2c6e None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:04.428155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c863e-9480-4494-89fc-4ed484ee2c6e None admin] RBAC: Authorizing `identity:get_project(project_id=4f71780a4bea442195d2f0f30a0ff390)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:04.429602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c863e-9480-4494-89fc-4ed484ee2c6e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:04.431243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 563/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:04 2022] GET /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:04.437128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:04.534559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaced0-e2b8-419c-a45e-04126c6eb600 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:04.568138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaab19a-0e74-499a-b84d-d5f6046ab22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:04.568890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab19a-0e74-499a-b84d-d5f6046ab22b None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:04.569185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab19a-0e74-499a-b84d-d5f6046ab22b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:04.569463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab19a-0e74-499a-b84d-d5f6046ab22b None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390/users/a4511cdb1d2f4ff687e25af4014b22a3/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:04.571612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaab19a-0e74-499a-b84d-d5f6046ab22b None admin] RBAC: Authorizing `identity:create_grant(project_id=4f71780a4bea442195d2f0f30a0ff390, user_id=a4511cdb1d2f4ff687e25af4014b22a3, role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:04.573151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaab19a-0e74-499a-b84d-d5f6046ab22b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:04.633205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:04.638588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 560/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:22:04 2022] PUT /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390/users/a4511cdb1d2f4ff687e25af4014b22a3/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:22:06.596109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c198024-617d-478c-9682-00bdd172c550 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:06.596585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c198024-617d-478c-9682-00bdd172c550 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:06.596674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c198024-617d-478c-9682-00bdd172c550 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:06.598615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 564/1124] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:06.603708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:06.604095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:06.604273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:06.621934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:06.623121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:06.687453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 561/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:06.711441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c198024-617d-478c-9682-00bdd172c550 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:06.760191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:06.809624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c198024-617d-478c-9682-00bdd172c550 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:06.841711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:06.842332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:06.842608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:06.842876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] PATH_INFO: `/v3/roles/2e725d333b9d463d9dddc121d6ec6e14` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:06.844287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] RBAC: Authorizing `identity:get_role(role_id=2e725d333b9d463d9dddc121d6ec6e14)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:06.845664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:06.846973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 565/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:06 2022] GET /identity/v3/roles/2e725d333b9d463d9dddc121d6ec6e14 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:06.853491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:06.948465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193232-df77-4d18-b307-40bc5629f052 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:06.974082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:06.981497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:06.982136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:06.982414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:06.982689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] PATH_INFO: `/v3/users/a4511cdb1d2f4ff687e25af4014b22a3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:06.983847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] RBAC: Authorizing `identity:get_user(user_id=a4511cdb1d2f4ff687e25af4014b22a3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:06.985309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:06.986906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 562/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:06 2022] GET /identity/v3/users/a4511cdb1d2f4ff687e25af4014b22a3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:06.992897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:07.090371 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0431e-e590-4f93-b577-2e6eca7d2c8b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:07.106343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:07.124276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:07.125160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:07.125446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:07.125722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:07.190134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:07.191569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:07.284135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 566/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:07.290510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:07.386854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb131a-7b3d-4b23-ac5a-744800f3e90a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:07.420686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46d212-a71c-403a-8797-609a72a2b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:07.421335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46d212-a71c-403a-8797-609a72a2b024 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:07.421614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46d212-a71c-403a-8797-609a72a2b024 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:07.421886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46d212-a71c-403a-8797-609a72a2b024 None admin] PATH_INFO: `/v3/projects/4f71780a4bea442195d2f0f30a0ff390` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:07.423013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46d212-a71c-403a-8797-609a72a2b024 None admin] RBAC: Authorizing `identity:get_project(project_id=4f71780a4bea442195d2f0f30a0ff390)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:07.424416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46d212-a71c-403a-8797-609a72a2b024 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:07.426103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 563/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:07 2022] GET /identity/v3/projects/4f71780a4bea442195d2f0f30a0ff390 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:07.432102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:07.448879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:07.531529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc1719-b4d3-420e-b835-cc4b9cd05d8e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:07.564866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:07.565465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:07.565742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:07.566010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:07.566856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] RBAC: Adding query filter params (role.id=2e725d333b9d463d9dddc121d6ec6e14, scope.project.id=4f71780a4bea442195d2f0f30a0ff390, user.id=a4511cdb1d2f4ff687e25af4014b22a3) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:07.567266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:07.568676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44749c-4d7d-4799-84be-d40036cfa251 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:07.574232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 567/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:22:07 2022] GET /identity/v3/role_assignments?user.id=a4511cdb1d2f4ff687e25af4014b22a3&scope.project.id=4f71780a4bea442195d2f0f30a0ff390&role.id=2e725d333b9d463d9dddc121d6ec6e14 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:09.591277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96037c-3a59-43d4-9b4c-04eda7bea7ce None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:09.591837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96037c-3a59-43d4-9b4c-04eda7bea7ce None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:09.591837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96037c-3a59-43d4-9b4c-04eda7bea7ce None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:09.593242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 564/1131] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:09.599058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:09.599499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:09.599605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:09.617192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:09.618362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:09.682124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 568/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:09.705066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96037c-3a59-43d4-9b4c-04eda7bea7ce None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:09.766833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:09.804649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96037c-3a59-43d4-9b4c-04eda7bea7ce None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:09.838338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e0cbd-9f9e-42e2-8a02-a605bdb9d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:09.838960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e0cbd-9f9e-42e2-8a02-a605bdb9d3bd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:09.839243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e0cbd-9f9e-42e2-8a02-a605bdb9d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:09.839519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e0cbd-9f9e-42e2-8a02-a605bdb9d3bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:09.840662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e0cbd-9f9e-42e2-8a02-a605bdb9d3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:09.842116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e0cbd-9f9e-42e2-8a02-a605bdb9d3bd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:09.843719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 565/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:09.850358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:09.861578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:09.945634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d512cd6-edf6-4cd6-ba8f-3dca70021c45 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:09.977970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612c1cf-954d-4806-ba86-2e7658fe2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:09.978573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612c1cf-954d-4806-ba86-2e7658fe2a41 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:09.978850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612c1cf-954d-4806-ba86-2e7658fe2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:09.979119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612c1cf-954d-4806-ba86-2e7658fe2a41 None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:09.979793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612c1cf-954d-4806-ba86-2e7658fe2a41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:09.981234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612c1cf-954d-4806-ba86-2e7658fe2a41 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:10.079859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 569/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:22:09 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:22:12.088225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f992ed-b097-4529-9467-8a512671e5f1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:12.089010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f992ed-b097-4529-9467-8a512671e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:12.089010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f992ed-b097-4529-9467-8a512671e5f1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:12.090167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 566/1135] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:12.095237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:12.095613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:12.095792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:12.114277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:12.115546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:12.169688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:12.180983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 570/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:12.204949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f992ed-b097-4529-9467-8a512671e5f1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:12.310449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f992ed-b097-4529-9467-8a512671e5f1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:12.338291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:12.342875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df807f-1b37-4fce-b9ad-50f34755b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:12.343496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df807f-1b37-4fce-b9ad-50f34755b5fd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:12.343775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df807f-1b37-4fce-b9ad-50f34755b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:12.344047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df807f-1b37-4fce-b9ad-50f34755b5fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:12.345198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df807f-1b37-4fce-b9ad-50f34755b5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:12.352354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df807f-1b37-4fce-b9ad-50f34755b5fd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:12.352354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 567/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:22:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:12.354539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:12.449008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1217bb-7fdd-4311-8158-83d7ae14a516 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:12.480960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4f9da-21fe-4734-bb7f-e5488e139e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:12.481554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4f9da-21fe-4734-bb7f-e5488e139e52 None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:12.481828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4f9da-21fe-4734-bb7f-e5488e139e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:12.482096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4f9da-21fe-4734-bb7f-e5488e139e52 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:12.482764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4f9da-21fe-4734-bb7f-e5488e139e52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:12.484169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4f9da-21fe-4734-bb7f-e5488e139e52 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:12.568536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 571/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:22:12 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:22:14.617019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d14f24-0008-41a9-a4ba-54dc6d8d95f8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:14.617564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d14f24-0008-41a9-a4ba-54dc6d8d95f8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:14.617564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d14f24-0008-41a9-a4ba-54dc6d8d95f8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:14.618941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 568/1139] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:14.623969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:14.624477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:14.624581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:14.642971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:14.644159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:14.686832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:14.709925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 572/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:14.732995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d14f24-0008-41a9-a4ba-54dc6d8d95f8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:14.832228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d14f24-0008-41a9-a4ba-54dc6d8d95f8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:14.865285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:14.865914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:14.866199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:14.866477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:14.876276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:22:14.881946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:14.883128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:22:14.884628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 569/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:22:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:14.889413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:14.984100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036956a6-34de-4db8-9418-a5e4a4c20e66 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:15.018155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:15.018763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:15.019043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:15.019430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:15.020141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:15.020450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:15.021855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:15.029591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 573/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:22:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:15.035310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:15.093417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:15.133637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1eefb-dc4a-4b9a-9915-222a28f9cf17 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:15.166979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:15.167603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:15.167887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:15.168161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] PATH_INFO: `/v3/users/ef791dec67cd4c60a06f9ae383eafea7` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:15.181364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] RBAC: Authorizing `identity:get_user(user_id=ef791dec67cd4c60a06f9ae383eafea7)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:15.182793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:15.184404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 570/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:15 2022] GET /identity/v3/users/ef791dec67cd4c60a06f9ae383eafea7 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:15.190143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:15.230769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:15.288550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4434a-20c8-4874-86ed-c235b1470ca9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:15.321139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:15.321750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:15.322033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:15.322332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:15.387758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:15.389188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:15.427804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:15.483103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 574/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:15.489836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:15.587632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36b72-be68-4404-828a-43dc6f16857c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:15.605522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:15.621897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20dc0-ade4-4f92-8414-a1c5894721e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:15.622537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20dc0-ade4-4f92-8414-a1c5894721e2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:15.622824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20dc0-ade4-4f92-8414-a1c5894721e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:15.623104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20dc0-ade4-4f92-8414-a1c5894721e2 None admin] PATH_INFO: `/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:15.624259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c20dc0-ade4-4f92-8414-a1c5894721e2 None admin] RBAC: Authorizing `identity:get_project(project_id=48dc1b15bcc7480fb0194f9f51ddc039)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:15.625738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c20dc0-ade4-4f92-8414-a1c5894721e2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:15.627388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 571/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:15 2022] GET /identity/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:15.633614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:15.729705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cbde1-6371-466f-b2b2-334377395ca3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:15.762174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:15.762779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:15.763069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:15.763345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:15.764119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=48dc1b15bcc7480fb0194f9f51ddc039, user.id=ef791dec67cd4c60a06f9ae383eafea7) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:15.764431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:15.765888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791db85-2861-4389-9c6a-560e84fc9bd3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:15.771691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 575/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:22:15 2022] GET /identity/v3/role_assignments?user.id=ef791dec67cd4c60a06f9ae383eafea7&scope.project.id=48dc1b15bcc7480fb0194f9f51ddc039&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:17.729266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e1bc-5d29-4738-8984-d21ce0c105cb None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:17.729810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e1bc-5d29-4738-8984-d21ce0c105cb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:17.729810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e1bc-5d29-4738-8984-d21ce0c105cb None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:17.731152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 572/1147] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:17.736336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:17.736771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:17.736930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:17.744088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:17.754975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:17.765194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:17.823211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 576/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:17.844999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e1bc-5d29-4738-8984-d21ce0c105cb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:17.944207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e1bc-5d29-4738-8984-d21ce0c105cb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:17.976670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:17.977318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:17.977602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:17.977875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:17.988259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:22:17.993331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:17.994402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:22:17.995291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 573/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:18.000335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:18.094882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0657-855c-4929-8482-d371b5833af4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:18.127462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:18.128065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:18.128361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:18.129176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:18.129882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:18.130182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:18.131541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:18.132892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:18.139854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 577/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:18.145948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:18.192699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:18.244354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125ced-0eed-4998-af1d-311e7e877d5b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:18.277037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:18.277656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:18.277936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:18.278209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] PATH_INFO: `/v3/users/ef791dec67cd4c60a06f9ae383eafea7` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:18.279365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] RBAC: Authorizing `identity:get_user(user_id=ef791dec67cd4c60a06f9ae383eafea7)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:18.280804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:18.282367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 574/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:18 2022] GET /identity/v3/users/ef791dec67cd4c60a06f9ae383eafea7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:18.288639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:18.384695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beace5-cdc5-4001-8430-ea4fc00dda56 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:18.417405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaccac-4674-4e28-b835-cb21b8f38a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:18.418028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaccac-4674-4e28-b835-cb21b8f38a4e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:18.418305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaccac-4674-4e28-b835-cb21b8f38a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:18.418576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaccac-4674-4e28-b835-cb21b8f38a4e None admin] PATH_INFO: `/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:18.419716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaccac-4674-4e28-b835-cb21b8f38a4e None admin] RBAC: Authorizing `identity:get_project(project_id=48dc1b15bcc7480fb0194f9f51ddc039)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:18.421168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaccac-4674-4e28-b835-cb21b8f38a4e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:18.422787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 578/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:18 2022] GET /identity/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:18.429681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:18.525468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad8c2-e677-4023-96a7-7f5eea2c11d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:18.539615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:18.559346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63c34b-0cec-4f7f-8d04-2fbf8c291ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:18.560006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63c34b-0cec-4f7f-8d04-2fbf8c291ecc None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:18.560291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63c34b-0cec-4f7f-8d04-2fbf8c291ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:18.560566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63c34b-0cec-4f7f-8d04-2fbf8c291ecc None admin] PATH_INFO: `/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039/users/ef791dec67cd4c60a06f9ae383eafea7/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:18.562521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63c34b-0cec-4f7f-8d04-2fbf8c291ecc None admin] RBAC: Authorizing `identity:create_grant(project_id=48dc1b15bcc7480fb0194f9f51ddc039, user_id=ef791dec67cd4c60a06f9ae383eafea7, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:18.563945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63c34b-0cec-4f7f-8d04-2fbf8c291ecc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:18.649825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 575/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:22:18 2022] PUT /identity/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039/users/ef791dec67cd4c60a06f9ae383eafea7/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:22:20.598458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390781-f8aa-4fb2-ab7c-a2735a93a69b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:20.598986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390781-f8aa-4fb2-ab7c-a2735a93a69b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:20.598986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390781-f8aa-4fb2-ab7c-a2735a93a69b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:20.600337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 579/1154] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:20.605341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:20.605723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:20.605906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:20.624155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:20.625377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:20.693734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 576/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:20.716347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390781-f8aa-4fb2-ab7c-a2735a93a69b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:20.778125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:20.816130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390781-f8aa-4fb2-ab7c-a2735a93a69b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:20.850086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:20.850710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:20.850992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:20.851267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:20.862090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:22:20.866966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:20.868072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:22:20.869045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 580/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:20.874142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:20.968917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919880-d1e4-446a-8898-a712569bd7ca None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:20.971127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:21.001764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:21.002422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:21.002937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:21.003256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:21.004360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:21.005017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:21.006412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:21.014508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 577/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:21.020863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:21.117825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4e8c-6bbd-46f9-80c1-651468ab8a79 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:21.139683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:21.150455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:21.151087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:21.151369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:21.151646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] PATH_INFO: `/v3/users/ef791dec67cd4c60a06f9ae383eafea7` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:21.152824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] RBAC: Authorizing `identity:get_user(user_id=ef791dec67cd4c60a06f9ae383eafea7)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:21.154256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:21.155836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 581/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:21 2022] GET /identity/v3/users/ef791dec67cd4c60a06f9ae383eafea7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:21.162175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:21.257133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438367-b0ec-4f11-9200-47648db7007f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:21.290059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:21.290665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:21.290948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:21.291225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:21.323240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:21.360986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:21.362775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:21.464126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 578/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:21.469869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:21.569138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee205-fbf0-4885-9cb3-fa9a2c9ebcff None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:21.600630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2482fe-b1ad-4d9e-85ea-4183938000b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:21.601291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2482fe-b1ad-4d9e-85ea-4183938000b6 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:21.601573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2482fe-b1ad-4d9e-85ea-4183938000b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:21.601852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2482fe-b1ad-4d9e-85ea-4183938000b6 None admin] PATH_INFO: `/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:21.602997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2482fe-b1ad-4d9e-85ea-4183938000b6 None admin] RBAC: Authorizing `identity:get_project(project_id=48dc1b15bcc7480fb0194f9f51ddc039)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:21.604433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2482fe-b1ad-4d9e-85ea-4183938000b6 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:21.606227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 582/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:21 2022] GET /identity/v3/projects/48dc1b15bcc7480fb0194f9f51ddc039 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:21.612277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:21.676035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:21.708873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f214dc-15e3-4ac0-ac6c-544daa86b755 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:21.740965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:21.741568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:21.741850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:21.742124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:21.742892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=48dc1b15bcc7480fb0194f9f51ddc039, user.id=ef791dec67cd4c60a06f9ae383eafea7) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:21.743198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:21.744601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7fb7e-033b-4af7-b343-9892f60341c1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:21.750173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 579/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:22:21 2022] GET /identity/v3/role_assignments?user.id=ef791dec67cd4c60a06f9ae383eafea7&scope.project.id=48dc1b15bcc7480fb0194f9f51ddc039&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:23.775713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17310856-7caa-45a6-8658-637e228fabca None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:23.776220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17310856-7caa-45a6-8658-637e228fabca None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:23.776220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17310856-7caa-45a6-8658-637e228fabca None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:23.777669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 583/1162] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:23.782759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:23.783178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:23.783312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:23.801521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:23.802683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:23.866950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 580/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:23.889870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17310856-7caa-45a6-8658-637e228fabca None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:23.948033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:23.987869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17310856-7caa-45a6-8658-637e228fabca None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:24.020317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:24.020949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:24.021230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:24.021506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:24.086464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:24.087854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:24.143560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:24.184181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 584/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:24.190428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:24.246230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:24.286282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50047-7c0c-49f0-a954-2ebaa719bf76 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:24.319166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:24.319792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:24.320070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:24.320340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:24.326821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:24.328244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2da7809b-04e8-4c74-a93f-87aa104ce017 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:24.339667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:24.340837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:22:24.341706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 581/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:22:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:24.347496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:24.443574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc409-0ca4-4c79-bcd5-185dde5f53d2 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:24.476188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:24.476816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:24.477100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:24.477376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:24.478050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:24.478356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:24.479715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1042a-d6ab-40f7-ab63-d75102bc7462 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:24.486642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 585/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Jul 27 08:22:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:26.477283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009820-73ac-42eb-812e-b767e0a694d5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:26.477818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009820-73ac-42eb-812e-b767e0a694d5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:26.477818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e009820-73ac-42eb-812e-b767e0a694d5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:26.479210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 582/1167] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:26.484418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5c8a-813a-4b0f-8efc-40a3fffdf560 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:26.484875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5c8a-813a-4b0f-8efc-40a3fffdf560 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:26.485001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5c8a-813a-4b0f-8efc-40a3fffdf560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:26.502656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-93ca5c8a-813a-4b0f-8efc-40a3fffdf560 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:26.504374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-93ca5c8a-813a-4b0f-8efc-40a3fffdf560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:26.522039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:26.569521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 586/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:26.592645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009820-73ac-42eb-812e-b767e0a694d5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:26.691407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e009820-73ac-42eb-812e-b767e0a694d5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:26.710996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:26.724496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20ab22-4e81-4b2a-b5db-d1ab4faa8005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:26.725128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ab22-4e81-4b2a-b5db-d1ab4faa8005 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:26.725415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ab22-4e81-4b2a-b5db-d1ab4faa8005 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:26.725692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ab22-4e81-4b2a-b5db-d1ab4faa8005 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:26.726403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20ab22-4e81-4b2a-b5db-d1ab4faa8005 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:26.727872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20ab22-4e81-4b2a-b5db-d1ab4faa8005 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:26.829971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 583/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Wed Jul 27 08:22:26 2022] POST /identity/v3/domains => generated 267 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:22:28.846880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbfc5-769d-4cc5-a0b7-a3eeb76a5c9f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:28.848087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbfc5-769d-4cc5-a0b7-a3eeb76a5c9f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:28.848087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbfc5-769d-4cc5-a0b7-a3eeb76a5c9f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:28.849271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 587/1170] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:28.854481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:28.854880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:28.855038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:28.873407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:28.874584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:28.938706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 584/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:28.961497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbfc5-769d-4cc5-a0b7-a3eeb76a5c9f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:29.060768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbfc5-769d-4cc5-a0b7-a3eeb76a5c9f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:29.093750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b80a8-8e57-4820-b105-19f7d7837fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:29.094373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b80a8-8e57-4820-b105-19f7d7837fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:29.094656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b80a8-8e57-4820-b105-19f7d7837fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:29.094932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b80a8-8e57-4820-b105-19f7d7837fb0 None admin] PATH_INFO: `/v3/domains/6a3a8d6291a74d368952771d62a2e40d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:29.105953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b80a8-8e57-4820-b105-19f7d7837fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a3a8d6291a74d368952771d62a2e40d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:29.107334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b80a8-8e57-4820-b105-19f7d7837fb0 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:29.108950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 588/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Jul 27 08:22:28 2022] GET /identity/v3/domains/6a3a8d6291a74d368952771d62a2e40d => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:29.114881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:29.210356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49f9c4-3c40-4e44-af64-f83b6400a779 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:29.220501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:29.243246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ee59d-e8be-4fdb-ad54-943f03dcecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:29.243852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee59d-e8be-4fdb-ad54-943f03dcecd3 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:29.244133 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee59d-e8be-4fdb-ad54-943f03dcecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:29.244408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee59d-e8be-4fdb-ad54-943f03dcecd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:29.245104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ee59d-e8be-4fdb-ad54-943f03dcecd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:29.246598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ee59d-e8be-4fdb-ad54-943f03dcecd3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:29.335411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 585/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:22:29 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:22:31.349718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7abf-3f37-4c7a-ac96-fc3ca2ca0051 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:31.350256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7abf-3f37-4c7a-ac96-fc3ca2ca0051 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:31.350256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7abf-3f37-4c7a-ac96-fc3ca2ca0051 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:31.351605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 589/1174] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:31.356744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:31.357134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:31.357303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:31.375515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:31.376681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:31.440738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 586/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:31.464934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7abf-3f37-4c7a-ac96-fc3ca2ca0051 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:31.480674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:31.564973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7abf-3f37-4c7a-ac96-fc3ca2ca0051 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:31.598520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40165a-46b6-4bfc-8d31-0335b3675e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:31.599143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40165a-46b6-4bfc-8d31-0335b3675e8e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:31.599422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40165a-46b6-4bfc-8d31-0335b3675e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:31.599693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40165a-46b6-4bfc-8d31-0335b3675e8e None admin] PATH_INFO: `/v3/domains/6a3a8d6291a74d368952771d62a2e40d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:31.600902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40165a-46b6-4bfc-8d31-0335b3675e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a3a8d6291a74d368952771d62a2e40d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:31.602270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40165a-46b6-4bfc-8d31-0335b3675e8e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:31.603838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 590/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Jul 27 08:22:31 2022] GET /identity/v3/domains/6a3a8d6291a74d368952771d62a2e40d => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:31.609602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:31.696932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:31.705171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4838b-3989-4636-a0a3-50274494d131 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:31.738444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aee4a-2b0c-4191-912f-ed11b2f2d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:31.739057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aee4a-2b0c-4191-912f-ed11b2f2d49d None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:31.739344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aee4a-2b0c-4191-912f-ed11b2f2d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:31.739621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aee4a-2b0c-4191-912f-ed11b2f2d49d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:31.740302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aee4a-2b0c-4191-912f-ed11b2f2d49d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:31.741758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aee4a-2b0c-4191-912f-ed11b2f2d49d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:31.848230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 587/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:22:31 2022] POST /identity/v3/users => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:22:33.848494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a002-301a-454e-8b71-cc4fab2c9f58 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:33.849031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a002-301a-454e-8b71-cc4fab2c9f58 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:33.849031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a002-301a-454e-8b71-cc4fab2c9f58 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:33.850335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 591/1178] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:33.855503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:33.855926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:33.856066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:33.874427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:33.875615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:33.941380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 588/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:33.964135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a002-301a-454e-8b71-cc4fab2c9f58 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:34.044222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:34.062875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a002-301a-454e-8b71-cc4fab2c9f58 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:34.096696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:34.097975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:34.098255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:34.098575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:34.108191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:22:34.113754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:34.114827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:22:34.115835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 592/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:34.120910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:34.195816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:34.215952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff933858-5c63-45e8-9bd0-3c35a63f13af None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:34.249418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:34.250023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:34.250305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:34.250581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:34.251349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:34.251839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:34.253549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:34.262004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 589/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:22:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:34.267741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:34.364304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcedc5-4d8b-4568-9d4c-2435d55efbbf None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:34.396001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:34.396615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:34.396917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:34.397189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] PATH_INFO: `/v3/users/a607eb1f9403478b8e9ac58a33b246d6` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:34.407624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:34.410468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a607eb1f9403478b8e9ac58a33b246d6)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:34.411891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:34.413500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 593/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:34 2022] GET /identity/v3/users/a607eb1f9403478b8e9ac58a33b246d6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:34.420356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:34.514728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4ce1d-525a-475f-aca1-6292d5618ca0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:34.548214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:34.548859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:34.549145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:34.549419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:34.559418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:34.613970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:34.615458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:34.709640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 590/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:34.715550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:34.883744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57eee2-caaa-4a3e-b83b-86cbfc5cc4e7 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:34.915763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3302-c31c-4001-9336-9d5f838e90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:34.916380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3302-c31c-4001-9336-9d5f838e90c5 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:34.916656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3302-c31c-4001-9336-9d5f838e90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:34.916962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3302-c31c-4001-9336-9d5f838e90c5 None admin] PATH_INFO: `/v3/projects/8260a810722544b5a2b02755d14b2c0e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:34.918084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3302-c31c-4001-9336-9d5f838e90c5 None admin] RBAC: Authorizing `identity:get_project(project_id=8260a810722544b5a2b02755d14b2c0e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:34.919502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3302-c31c-4001-9336-9d5f838e90c5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:34.921163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 594/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:34 2022] GET /identity/v3/projects/8260a810722544b5a2b02755d14b2c0e => generated 361 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:34.927584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:34.968505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:35.025374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897ff1-7228-4431-80ba-2657e2fbecf2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:35.058480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:35.059085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:35.059368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:35.059643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:35.060423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=8260a810722544b5a2b02755d14b2c0e, user.id=a607eb1f9403478b8e9ac58a33b246d6) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:35.060749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:35.062177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4228f-88ed-4ce9-9af1-67f0a0936de0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:35.068114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 591/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:22:34 2022] GET /identity/v3/role_assignments?user.id=a607eb1f9403478b8e9ac58a33b246d6&scope.project.id=8260a810722544b5a2b02755d14b2c0e&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:37.031500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c8296-7a12-485a-ba22-8e76f7ab4d94 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.032017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c8296-7a12-485a-ba22-8e76f7ab4d94 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.032127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c8296-7a12-485a-ba22-8e76f7ab4d94 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.033443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 595/1186] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:37.038571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.039017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.039113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.057080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:37.058273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:37.122653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 592/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:22:37.146205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c8296-7a12-485a-ba22-8e76f7ab4d94 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:37.211661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:37.243936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c8296-7a12-485a-ba22-8e76f7ab4d94 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:37.277662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:37.278283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.278563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.278837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.288895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:22:37.293689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:37.294749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:22:37.295799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 596/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:37.301586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:37.334750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:37.399981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b626cf7-0f06-486c-aa2f-e2dd40d9f70b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:37.432572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:37.433214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.433500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.433778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.434486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:37.434795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:37.436151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:37.444789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 593/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:37.450519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:37.546322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d7ac6-d27e-4005-9839-dcb4fe97768f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:37.572229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:37.579640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:37.580267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.581764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.581764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] PATH_INFO: `/v3/users/a607eb1f9403478b8e9ac58a33b246d6` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.582039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] RBAC: Authorizing `identity:get_user(user_id=a607eb1f9403478b8e9ac58a33b246d6)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:37.583455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:37.585070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 597/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:37 2022] GET /identity/v3/users/a607eb1f9403478b8e9ac58a33b246d6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:37.590815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:37.683799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:37.689341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf499a-af9c-4195-9d1c-fddb6b7c7e9f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:37.722691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a29f9-51c7-4405-aad3-5eab0ab6a17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:37.723321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a29f9-51c7-4405-aad3-5eab0ab6a17f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.723607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a29f9-51c7-4405-aad3-5eab0ab6a17f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.723888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a29f9-51c7-4405-aad3-5eab0ab6a17f None admin] PATH_INFO: `/v3/projects/8260a810722544b5a2b02755d14b2c0e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.725169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a29f9-51c7-4405-aad3-5eab0ab6a17f None admin] RBAC: Authorizing `identity:get_project(project_id=8260a810722544b5a2b02755d14b2c0e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:37.726586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a29f9-51c7-4405-aad3-5eab0ab6a17f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:37.728239 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 594/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:37 2022] GET /identity/v3/projects/8260a810722544b5a2b02755d14b2c0e => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:37.734306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:37.829000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8ce1-9aff-48dd-bff5-ccee2c4cda12 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:37.861608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da14f5-c9d6-49ad-ba98-767414497130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:37.862277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da14f5-c9d6-49ad-ba98-767414497130 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:37.863190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da14f5-c9d6-49ad-ba98-767414497130 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:37.863594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da14f5-c9d6-49ad-ba98-767414497130 None admin] PATH_INFO: `/v3/projects/8260a810722544b5a2b02755d14b2c0e/users/a607eb1f9403478b8e9ac58a33b246d6/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:37.865517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da14f5-c9d6-49ad-ba98-767414497130 None admin] RBAC: Authorizing `identity:create_grant(project_id=8260a810722544b5a2b02755d14b2c0e, user_id=a607eb1f9403478b8e9ac58a33b246d6, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:37.866940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da14f5-c9d6-49ad-ba98-767414497130 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:37.948057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 598/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:22:37 2022] PUT /identity/v3/projects/8260a810722544b5a2b02755d14b2c0e/users/a607eb1f9403478b8e9ac58a33b246d6/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:22:39.910962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57594ac-693d-4821-8051-381202db7e5c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:39.911459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57594ac-693d-4821-8051-381202db7e5c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:39.911459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57594ac-693d-4821-8051-381202db7e5c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:39.912814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 595/1193] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:22:39.918009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:39.918449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:39.918554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:39.936825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:22:39.937996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:22:39.986285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:40.002892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 599/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:22:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:22:40.026823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57594ac-693d-4821-8051-381202db7e5c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:40.124523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57594ac-693d-4821-8051-381202db7e5c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:40.156526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:40.157176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:40.157459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:40.157733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:40.167980 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:22:40.172831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:22:40.173906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:22:40.175508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 596/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:22:40.180386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:40.275338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7825-3852-4e1f-b689-b9580dc52538 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:40.307860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:40.308466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:40.308766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:40.309048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:40.309753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:40.310061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:40.311426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:40.319400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 600/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:22:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:40.325068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:40.351104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:40.423425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9510635-dc4e-4468-ab98-6b8deae3f978 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:40.455698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:40.456888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:40.457170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:40.457442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] PATH_INFO: `/v3/users/a607eb1f9403478b8e9ac58a33b246d6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:40.458599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] RBAC: Authorizing `identity:get_user(user_id=a607eb1f9403478b8e9ac58a33b246d6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:40.460019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:40.461719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 597/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Jul 27 08:22:40 2022] GET /identity/v3/users/a607eb1f9403478b8e9ac58a33b246d6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:40.467462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:40.515622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:40.565670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d806-9440-4836-9fa1-9bbec828fa3c None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:40.598776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:40.599455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:40.599741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:40.600014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:40.664806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:40.666254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:40.711747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:40.762160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 601/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:22:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:22:40.768051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:40.855772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:40.864595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77b970-4830-4908-9fec-a26007d08fea None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:40.897921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484347-5b67-4707-ab12-0acbcb974a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:40.898555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484347-5b67-4707-ab12-0acbcb974a5e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:40.898840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484347-5b67-4707-ab12-0acbcb974a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:40.899121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484347-5b67-4707-ab12-0acbcb974a5e None admin] PATH_INFO: `/v3/projects/8260a810722544b5a2b02755d14b2c0e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:40.900263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484347-5b67-4707-ab12-0acbcb974a5e None admin] RBAC: Authorizing `identity:get_project(project_id=8260a810722544b5a2b02755d14b2c0e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:40.901705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484347-5b67-4707-ab12-0acbcb974a5e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:40.903349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 598/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Jul 27 08:22:40 2022] GET /identity/v3/projects/8260a810722544b5a2b02755d14b2c0e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:22:40.909909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:22:41.003513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2e86-70a7-4c2e-974a-aade04155ea3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:22:41.037103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:22:41.037703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:22:41.037982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:22:41.038251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:22:41.039015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=8260a810722544b5a2b02755d14b2c0e, user.id=a607eb1f9403478b8e9ac58a33b246d6) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:22:41.039321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:22:41.040756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457990ca-0316-42c8-8206-d227dbe85e98 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:22:41.046323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 602/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:22:40 2022] GET /identity/v3/role_assignments?user.id=a607eb1f9403478b8e9ac58a33b246d6&scope.project.id=8260a810722544b5a2b02755d14b2c0e&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:22:50.893833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=20 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:22:51.043760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:53.412169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2bfd-3fe3-4373-86df-68184745211f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:53.412843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2bfd-3fe3-4373-86df-68184745211f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:53.412843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2bfd-3fe3-4373-86df-68184745211f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:53.414113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 599/1201] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:23:53.419188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:53.420131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:53.420131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:53.439450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:23:53.440638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:23:53.506313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 603/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:23:53.530686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2bfd-3fe3-4373-86df-68184745211f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:53.632329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2bfd-3fe3-4373-86df-68184745211f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:53.673434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:53.674049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:53.674325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:53.674629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:53.684529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:53.686005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:23:53.700403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:23:53.705551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:23:53.706535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:23:53.706535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:23:53.706535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:23:53.706535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:23:53.706535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 600/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:23:53.708275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:53.806219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b672b42-a32a-4a9f-b4d9-58ddbba91d8c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:53.834743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:53.840590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:53.841261 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:53.841542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:53.841815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:53.842496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:53.842803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:53.844851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddfd71-9f96-4a28-b8a5-1b88a14d6e70 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:53.855962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 604/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:23:53.861818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:53.915551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:53.961691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899caa75-b8e3-48de-94ac-4d109efc6699 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:53.995075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a62b-360a-4420-8bfc-49a73969cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:53.995646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a62b-360a-4420-8bfc-49a73969cc79 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:53.995927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a62b-360a-4420-8bfc-49a73969cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:53.996198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a62b-360a-4420-8bfc-49a73969cc79 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:53.996910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1a62b-360a-4420-8bfc-49a73969cc79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:53.998362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1a62b-360a-4420-8bfc-49a73969cc79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:54.082516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 601/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Jul 27 08:23:53 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:23:56.138821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982826-0416-476c-9fc6-7512d2454516 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:56.139437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982826-0416-476c-9fc6-7512d2454516 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:56.139437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982826-0416-476c-9fc6-7512d2454516 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:56.140720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 605/1206] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:23:56.145912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:56.150370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:56.150370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:56.164284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:23:56.165487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:23:56.230031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 602/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:23:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:23:56.255493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982826-0416-476c-9fc6-7512d2454516 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:56.354885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982826-0416-476c-9fc6-7512d2454516 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:56.389796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:56.390355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:56.390687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:56.390967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:56.401193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:23:56.406019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:23:56.407627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:23:56.408913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 606/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:23:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:23:56.413721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:56.452958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:56.514706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d3900-2073-4741-9555-63b3b41178d9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:56.549787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:56.550675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:56.551164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:56.552010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:56.552819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:56.559058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:56.559058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:56.562779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 603/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:23:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:23:56.568596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:56.618488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:56.666565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3bdcf-36d7-4229-85c9-a0591153b987 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:56.700105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:56.700793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:56.701080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:56.701355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:56.712092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:56.713570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:23:56.728314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:23:56.733095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:23:56.734218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:23:56.734218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:23:56.734218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:23:56.734218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:23:56.734218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 607/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:23:56.735611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:56.830590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:56.833341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909414e-8584-4f90-b352-768af7c320c8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:56.866153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:56.866782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:56.867043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:56.867316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:56.867992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:56.868293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:56.869663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:56.880907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 604/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:23:56.886768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:56.986691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12e8e-0a1d-4a35-a590-f556a8ba3509 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:56.988188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:57.019638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:57.020265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:57.020544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:57.020844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:57.029026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:57.030467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:23:57.042171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:23:57.043317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:23:57.044468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 608/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:23:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:23:57.049380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:57.148452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd169-bd2a-41b0-b267-582ef64342b6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:57.180914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:57.181533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:57.181817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:57.182094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:57.182888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:57.183197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:57.184765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:57.202086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 605/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Jul 27 08:23:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:23:57.208502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:57.307802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92876df-5a34-481d-8b7c-72fbdbc75f22 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:57.341950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:57.342590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:57.342870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:57.343141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:57.371936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:57.408782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:57.410243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:57.508661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 609/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:23:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:23:57.515241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:57.534448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:57.614199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980bd85-e2e3-443f-98f7-8b5117d359fe None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:57.647556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:57.648184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:57.648464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:57.648759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:57.660041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:57.661629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:23:57.676587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:23:57.679062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:23:57.680340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:23:57.680340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:23:57.680340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:23:57.680340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:23:57.680340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 606/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:23:57.683549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:57.743455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:57.782889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91e35-7c20-481f-8c06-bb3539f01f0e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:57.817464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:57.818085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:57.818365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:57.818633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:57.819301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:57.819601 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:57.820978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:57.831806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 610/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:23:57.837527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:57.908122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:57.939995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8c3da-275f-4cff-a032-4863e440e52d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:57.972571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:57.973223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:57.973503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:57.973776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:57.980089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:57.981539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:23:57.992676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:23:57.994795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:23:57.995983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 607/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:23:58.000431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:58.098369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d2503-ff72-4a03-9d5e-833778c4899f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:58.119165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:58.131012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:58.131622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:58.131901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:58.132175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:58.132926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:58.133229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:58.134637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050c3f1-9c6c-46f3-bbf3-1238a31d456a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:58.146531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 611/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:23:58.152837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:23:58.254858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef57dc-21ad-4b7e-88e0-562e17ce3f66 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:23:58.281665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:23:58.287314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:23:58.287925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:23:58.288214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:23:58.288490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:23:58.289295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=9b2f62b5c7154b66841484f2c1f5cd28) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:23:58.289607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:23:58.291018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef19fb8-f7bd-4690-8c65-f55b6179c544 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:23:58.296203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 608/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:23:58 2022] GET /identity/v3/role_assignments?user.id=9b2f62b5c7154b66841484f2c1f5cd28&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:00.264517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb7d33-b836-46ed-9a03-3b321654fdca None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:00.265074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb7d33-b836-46ed-9a03-3b321654fdca None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:00.265183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb7d33-b836-46ed-9a03-3b321654fdca None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:00.266702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 612/1220] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:00.271911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:00.274930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:00.274930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:00.290899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:00.292082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:00.359020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 609/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:00.382623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb7d33-b836-46ed-9a03-3b321654fdca None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:00.482324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb7d33-b836-46ed-9a03-3b321654fdca None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:00.522748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:00.522748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:00.522748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:00.522748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:00.528773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:24:00.534306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:00.535439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:00.536395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 613/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:00.541614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:00.636806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbff1f-9b11-490e-b3c3-b7811cc6c85e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:00.659820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:00.669830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:00.670429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:00.670706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:00.670975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:00.671732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:00.672041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:00.673415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:00.680946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 610/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:00.686849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:00.731232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:00.787567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ff70-afb2-44c6-a587-9a76ad8af31a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:00.819421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:00.820950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:00.821216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:00.821490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:00.832522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:00.834003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:00.848288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:00.849398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:00.850778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:00.850778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:00.850778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:00.850778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:00.850778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 614/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:00.855541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:00.957984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bfe08-0b4b-4415-8639-4cc61621e697 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:00.990964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:00.991578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:00.991865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:00.992143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:00.992857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:00.993168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:00.994571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.007141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 611/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:01.012998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:01.106146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:01.112940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01b382-feda-4d1e-a90c-d5bbde19aa7a None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:01.145875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:01.146494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:01.146771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:01.147037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:01.154175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:01.155598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:24:01.166744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:01.167891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:01.174653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 615/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:01.175374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:01.219975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:01.271696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e697b9-1f1f-4323-b3e0-59c91ca7ec74 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:01.304479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:01.305127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:01.305408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:01.305681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:01.306466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:01.306770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:01.308189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.325326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 612/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Jul 27 08:24:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:01.331047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:01.430468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdf348-51ed-49a7-83b7-85746dae9872 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:01.463314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:01.463952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:01.464232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:01.464507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:01.474649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:01.476135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:01.490231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:01.491286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:01.492289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:01.492289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:01.492289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:01.492289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:01.492289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 616/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:01.497330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:01.596011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b861f-7801-44aa-ae01-a33124b22ff3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:01.598328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:01.629354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:01.630167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:01.630660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:01.631265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:01.631973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:01.632284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:01.633688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.644847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 613/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:01.650682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:01.660516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:01.749809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d97cf-93c2-4786-ad2c-89bbbd281198 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:01.782278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:01.782905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:01.783184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:01.783452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:01.789893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:01.791325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:24:01.803502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:01.804538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:01.805537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 617/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:01.810551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:01.910950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c76a-7ac8-4651-87fb-2957c0ceeaf2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:01.943961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:01.944573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:01.944887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:01.945166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:01.945912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:01.946221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:01.947640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e738b-610b-40ad-a7f3-6490e2c8e65b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:01.959990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 614/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:01.966103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:02.030302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:02.063975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf183-c60e-4d3a-b80a-080350db47db None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:02.096519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f6aa5-5f2a-42f8-94e6-259afd1903c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:02.097213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6aa5-5f2a-42f8-94e6-259afd1903c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:02.097544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6aa5-5f2a-42f8-94e6-259afd1903c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:02.097842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6aa5-5f2a-42f8-94e6-259afd1903c5 None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/9b2f62b5c7154b66841484f2c1f5cd28/roles/481854e4585944ddbf20ff16791e006a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:02.112402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f6aa5-5f2a-42f8-94e6-259afd1903c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=9b2f62b5c7154b66841484f2c1f5cd28, role_id=481854e4585944ddbf20ff16791e006a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:02.113877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f6aa5-5f2a-42f8-94e6-259afd1903c5 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:02.237315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 618/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:24:01 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/9b2f62b5c7154b66841484f2c1f5cd28/roles/481854e4585944ddbf20ff16791e006a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:24:04.223334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3dbf-b680-4705-9d2c-c890df265459 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:04.223919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3dbf-b680-4705-9d2c-c890df265459 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:04.223919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3dbf-b680-4705-9d2c-c890df265459 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:04.225295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 615/1233] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:04.230329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:04.230707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:04.230877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:04.248699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:04.250265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:04.315551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 619/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:04.338733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3dbf-b680-4705-9d2c-c890df265459 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:04.363841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:04.438245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3dbf-b680-4705-9d2c-c890df265459 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:04.471729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:04.472356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:04.472633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:04.472933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:04.482869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:24:04.488008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:04.489000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:04.489968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 616/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Jul 27 08:24:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:04.495351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:04.542226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:04.593045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09160-d9f9-4a04-8a1a-ae818dabe3d6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:04.626037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:04.626644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:04.626923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:04.627196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:04.627902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] RBAC: Adding query filter params (name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:04.628473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:04.629873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:04.637592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 620/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Jul 27 08:24:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:04.643974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:04.726591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:04.741954 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42bc7-4632-4e6a-8b3f-41c5477542b1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:04.775097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:04.775730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:04.776015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:04.776291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:04.786104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:04.787563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:04.801900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:04.804666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:04.805809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:04.805809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:04.805809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:04.805809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:04.805809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 617/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:24:04.808870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:04.909736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e0ff4-3384-4e47-98ea-1faf07e87eee None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:04.918503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:04.943177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:04.943806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:04.944090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:04.944362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:04.945105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:04.945417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:04.946819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:04.959423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 621/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:04.965221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:05.065832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef6857-6e77-471e-90c0-4d5a0262f4c9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:05.098377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:05.099013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:05.099297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:05.099573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:05.102253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:05.107325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:05.109409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:24:05.120566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:05.122230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:05.123397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 618/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:05.128623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:05.225789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f62ace-a18d-47bc-a2de-38fc85340731 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:05.261095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:05.261762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:05.261964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:05.262228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:05.263128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:05.263336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:05.264758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:05.281520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 622/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Jul 27 08:24:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:05.287364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:05.387115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dcf34-506c-4593-ac8a-f2d7404da8ea None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:05.420438 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:05.421069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:05.421904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:05.422210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:05.480741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:05.488049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:05.489528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:05.589042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 619/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:24:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:24:05.595535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:05.623286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:05.694662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83ed8-4c6e-4f83-b8c0-366f2cfaddd4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:05.728716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:05.729381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:05.729667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:05.729942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:05.739913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:05.741403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:05.756487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:05.760400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:05.761513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:05.761513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:05.761513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:05.761513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:05.761513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 623/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:05.763398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:05.855544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:05.861917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfb0e8-ee5c-438c-88f9-9798b67e625c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:05.895195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:05.895828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:05.896093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:05.896369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:05.897083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:05.897387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:05.898741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:05.910158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 620/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:05.915861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:05.992362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:06.012932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b38e3-54ff-4d9e-8fb3-e8a058f26e5b None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:06.045468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:06.046105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:06.046387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:06.046660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:06.053233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:06.054686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:24:06.066617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:06.067691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:06.068847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 624/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:06.073633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:06.171527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d113e-dfee-4365-82f1-f31a98b863f4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:06.204932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:06.205546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:06.205835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:06.206106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:06.206844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:06.207153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:06.208610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d3df6-925f-4cb0-800e-b1f13623e814 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:06.220362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 621/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:24:06.226457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:06.324355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfccee3-cdfd-4521-b2a4-bcaab5da6ffa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:06.357002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:06.357611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:06.357891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:06.358165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:06.359031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] RBAC: Adding query filter params (role.id=481854e4585944ddbf20ff16791e006a, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=9b2f62b5c7154b66841484f2c1f5cd28) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:06.359443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:06.360927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69536f-03a9-4a20-af9f-50ecb7605106 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:06.366507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 625/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:24:06 2022] GET /identity/v3/role_assignments?user.id=9b2f62b5c7154b66841484f2c1f5cd28&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=481854e4585944ddbf20ff16791e006a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:08.452701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89dd5f-f26b-4da0-b9a0-77c61d48387f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:08.453290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89dd5f-f26b-4da0-b9a0-77c61d48387f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:08.453290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89dd5f-f26b-4da0-b9a0-77c61d48387f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:08.454653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 622/1247] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:08.459958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:08.460356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:08.460511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:08.466872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:08.479560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:08.480844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:08.546197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 626/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:08.570138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89dd5f-f26b-4da0-b9a0-77c61d48387f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:08.588337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:08.671760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89dd5f-f26b-4da0-b9a0-77c61d48387f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:08.705418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:08.705989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:08.706273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:08.706550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:08.716333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:24:08.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:08.723035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:08.723993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 623/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:08.729436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:08.827852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0d4b-71b7-43b7-a5fb-45fca62a49d7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:08.856383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:08.861223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:08.861863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:08.862141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:08.862449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:08.863145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:08.863443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:08.864842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:08.872785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 627/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:24:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:08.878928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:08.956744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:08.979307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b100-2454-4dad-8448-440b57f848c2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:09.014433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:09.015082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:09.015457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:09.015669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:09.026366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:09.027847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:09.045573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:09.046662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:09.047783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:09.047783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:09.047783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:09.047783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:09.047783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 624/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:09.052789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:09.150838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077e3c-b8e8-4345-b7e7-a2f0fd58259f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:09.182914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:09.183515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:09.183791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:09.184057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:09.184752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:09.185050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:09.186399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:09.198216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 628/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:09.204615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:09.301661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178572-5c41-4b0a-baa6-fca384287a30 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:09.330281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:09.337845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:09.338482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:09.338766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:09.339041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:09.346413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:09.347837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:24:09.359092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:09.360182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:09.361587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 625/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:09.366190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:09.421607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:09.467198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56977c82-154d-41dd-9551-6ec09bd3b44e None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:09.501537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:09.502258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:09.502537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:09.502809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:09.504057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:09.504364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:09.505828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:09.522971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 629/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Jul 27 08:24:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:09.528847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:09.630203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1339d70-cf1d-44d8-bf8a-5940cf8fdffc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:09.662955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:09.663565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:09.663844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:09.664115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:09.719851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:09.731689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:09.733167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:09.829331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 626/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:24:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:24:09.835270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:09.937101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe83812-2b88-4e47-933f-cad64c9f07c4 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:09.949990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:09.970766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:09.971401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:09.971685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:09.971960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:09.981824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:09.983360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:09.997699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:09.998755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:10.000646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:10.000646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:10.000646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:10.000646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:10.000646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 630/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:10.005672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:10.092605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:10.104319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9aec-61a6-4e44-a851-36db318d2c8f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:10.138062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:10.138660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:10.138940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:10.139215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:10.140475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:10.140893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:10.142261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:10.153106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 627/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:10.158835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:10.257678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542559e8-b77c-4e93-bfca-ef420f991094 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:10.289538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:10.290170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:10.290450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:10.290722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:10.297672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:10.299108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:24:10.310122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:10.317232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:10.318355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 631/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:10.318986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:10.416132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a54bd-b8e2-4001-ad4b-c7bf7b567d12 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:10.449874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:10.450486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:10.450768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:10.451043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:10.451789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:10.452097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:10.453684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd780b5-d32e-4ca2-b65a-74cd2772d024 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:10.465402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 628/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:24:10.471727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:10.497821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:10.572065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5181-eaa2-468b-a83b-bc11838dadf9 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:10.605298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:10.605911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:10.606195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:10.606471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:10.607253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=9b2f62b5c7154b66841484f2c1f5cd28) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:10.607565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:10.609723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853872-daf9-4309-8093-d2b154b523a8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:10.615171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 632/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:24:10 2022] GET /identity/v3/role_assignments?user.id=9b2f62b5c7154b66841484f2c1f5cd28&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:12.589286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516ea76-e8b8-4f8d-a8a9-7489119585b4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:12.589838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516ea76-e8b8-4f8d-a8a9-7489119585b4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:12.589931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516ea76-e8b8-4f8d-a8a9-7489119585b4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:12.591291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 629/1261] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:24:12.597467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870de00d-8478-4831-9819-9357c24cd334 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:12.597888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870de00d-8478-4831-9819-9357c24cd334 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:12.598021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870de00d-8478-4831-9819-9357c24cd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:12.616585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-870de00d-8478-4831-9819-9357c24cd334 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:12.622032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-870de00d-8478-4831-9819-9357c24cd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:12.684083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 633/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:12.707232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516ea76-e8b8-4f8d-a8a9-7489119585b4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:12.718657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:12.809285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516ea76-e8b8-4f8d-a8a9-7489119585b4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:12.845536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:12.846296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:12.846582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:12.846861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:12.857140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:24:12.862327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:12.863329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:12.864161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 630/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:12.869692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870de00d-8478-4831-9819-9357c24cd334 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:12.888477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:12.965572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870de00d-8478-4831-9819-9357c24cd334 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:12.999725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.000997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.001280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.001551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.002323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:13.002635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.008283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.012393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 634/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:13.018830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:13.084356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:13.115702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d90c-4c75-46a7-907d-4e9124a5a57b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:13.150477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.151110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.151390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.151664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.161621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.163069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:13.178412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:13.179495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:13.180899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:13.180899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:13.180899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:13.180899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:13.180899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 631/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:24:13.185449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:13.265851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:13.284924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4e69-a879-4abc-bd4f-2e17a7d5f505 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:13.318852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.319464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.319744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.320018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.320705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:13.322036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.322398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.333810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 635/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:13.339575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:13.439294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa5ad-b1b3-4a95-9b9d-ca4c33c72b7b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:13.459391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:13.473529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.474174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.474460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.474740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.483043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.485295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:24:13.496130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:13.497298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:13.501825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 632/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:24:13.504217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:13.604439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfbbaa-10da-4f86-a8b1-790dfb7c54ba None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:13.639785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.640490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.640798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.641186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.641971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:13.642276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.643705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.652178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:13.660860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 636/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:13.666511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:13.767271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452831b9-d818-43bb-8ab8-040d593e7558 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:13.800221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.800875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.801156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.801429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.811585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.813043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:13.826574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:13.827484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:13.828409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:13.828409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:13.828409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:13.828409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:13.828409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 633/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:13.833538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:13.933747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e0a6-1038-4a1b-af00-5a757a637793 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:13.969354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:13.969971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:13.970276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:13.970555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:13.971239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:13.971546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:13.972989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:13.984274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 637/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:13.990016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:14.022646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:14.089556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb05fc-3058-4b03-a7ca-9c7d0e83363c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:14.124120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:14.124783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:14.125089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:14.125346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:14.132043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:14.133498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:24:14.145041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:14.146073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:14.147042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 634/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:14.151964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:14.209537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:14.249863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3c9b-9dfd-4f69-8878-e6d08e429430 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:14.285358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:14.286045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:14.286327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:14.286603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:14.287345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:14.287655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:14.289120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518e4e-0e6a-4688-9b51-08ed3308b60b None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:14.301116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 638/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:14.307161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:14.398870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:14.407388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5635c-a9ab-4ed9-afae-e60ad508b7a8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:14.440704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5214a-43d5-44d8-aab6-bac8d350342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:14.441468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5214a-43d5-44d8-aab6-bac8d350342e None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:14.441747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5214a-43d5-44d8-aab6-bac8d350342e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:14.442018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5214a-43d5-44d8-aab6-bac8d350342e None admin] PATH_INFO: `/v3/projects/094706a52b994152a1b088b7bd48e068/users/9b2f62b5c7154b66841484f2c1f5cd28/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:14.443918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5214a-43d5-44d8-aab6-bac8d350342e None admin] RBAC: Authorizing `identity:create_grant(project_id=094706a52b994152a1b088b7bd48e068, user_id=9b2f62b5c7154b66841484f2c1f5cd28, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:14.445355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5214a-43d5-44d8-aab6-bac8d350342e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:14.539109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 635/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Jul 27 08:24:14 2022] PUT /identity/v3/projects/094706a52b994152a1b088b7bd48e068/users/9b2f62b5c7154b66841484f2c1f5cd28/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:24:16.540563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f980f-9f36-4c6c-b37b-0cf6e532214e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:16.541142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f980f-9f36-4c6c-b37b-0cf6e532214e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:16.541142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f980f-9f36-4c6c-b37b-0cf6e532214e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:16.542495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 639/1274] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:16.548700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:16.558377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:16.558377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:16.567622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:16.568850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:16.635496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 636/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:16.659268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f980f-9f36-4c6c-b37b-0cf6e532214e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:16.760713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f980f-9f36-4c6c-b37b-0cf6e532214e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:16.778414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:16.795390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:16.801408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:16.801408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:16.801408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:16.807269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:24:16.812252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:16.813468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:16.814566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 640/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Jul 27 08:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:16.819662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:16.901736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:16.919178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c71d4d-70a9-4748-85db-0dba9a7d6f05 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:16.952617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:16.953257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:16.953538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:16.953810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:16.954521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:16.954824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:16.956175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:16.963980 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 637/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Jul 27 08:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:16.970389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:17.069672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5090-f51e-4d14-b54a-648596751556 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:17.103315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:17.103941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:17.104220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:17.104490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:17.114405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:17.115884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:17.131297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:17.132409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:17.133562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:17.133562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:17.133562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:17.133562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:17.133562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 641/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:17.138206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:17.237882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309011ea-21c8-4b65-9dfa-b575a933cb7d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:17.273571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:17.274189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:17.274477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:17.274759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:17.275473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:17.275783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:17.277224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:17.289607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 638/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:17.295304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:17.325677 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:17.394598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cdde7-0fed-49ae-86bb-438f1a100888 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:17.426100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:17.426743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:17.427062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:17.427372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:17.434489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:17.435947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:24:17.448156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:17.449346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:17.450523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 642/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:17.456119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:17.459857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:17.553128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f34f5-0904-4a47-98b1-ac83ed08e3a1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:17.589447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:17.589989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:17.590269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:17.590542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:17.591359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:17.591657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:17.593613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:17.610685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 639/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Jul 27 08:24:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:17.616617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:17.711148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:17.720557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8b541-0112-4859-b918-de4456563ed3 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:17.754025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:17.754658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:17.754979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:17.755291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:17.820988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:17.822475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:17.908398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:17.918315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 643/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Jul 27 08:24:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:24:17.925246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:17.985813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:18.023984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d2cf5-09aa-4d75-a2c0-c4223b61017d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:18.057170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:18.057806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:18.058092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:18.058370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:18.069006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:18.070443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:24:18.085068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:18.086141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:18.087105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:24:18.087105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:24:18.087105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:24:18.087105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:18.087105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 640/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:18.092759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:18.189592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848b37f-4978-4120-90e8-a71eadde3fc1 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:18.222677 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:18.223312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:18.223633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:18.223944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:18.224663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:18.225034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:18.226434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:18.238372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 644/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Jul 27 08:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:18.244006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:18.344578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b66422-dd43-4712-9d12-e9ef2ca362e4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:18.357788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:18.378079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:18.378704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:18.378988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:18.379268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:18.385696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:18.392345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:24:18.398425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:18.399510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: ERROR keystone.server.flask.application Jul 27 08:24:18.405923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 641/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Jul 27 08:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:18.406637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:18.455452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:18.503946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b85e8-5750-4459-b3f7-eff0e86a88ae None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:18.537706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:18.538321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:18.538603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:18.538877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:18.539622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:18.539930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:18.541392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c1f4f-66b9-4b66-aa82-c2b604db4bdd None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:18.555669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 645/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Jul 27 08:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:18.562096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:18.661035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759a6be-a588-4993-99cd-e02df7c590a1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:18.692687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:18.693321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:18.693601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:18.693918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:18.694691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] RBAC: Adding query filter params (role.id=4cbefe0ba51848b9bc7724903bb75d4c, scope.project.id=094706a52b994152a1b088b7bd48e068, user.id=9b2f62b5c7154b66841484f2c1f5cd28) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:18.695000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:18.696425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b753b-7442-49ee-9e27-ad7bb58f0068 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:18.702630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 642/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Jul 27 08:24:18 2022] GET /identity/v3/role_assignments?user.id=9b2f62b5c7154b66841484f2c1f5cd28&scope.project.id=094706a52b994152a1b088b7bd48e068&role.id=4cbefe0ba51848b9bc7724903bb75d4c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:20.758343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22002aa-02f9-4ce1-b853-4969189504d7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:20.758892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22002aa-02f9-4ce1-b853-4969189504d7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:20.758892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22002aa-02f9-4ce1-b853-4969189504d7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:20.760234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 646/1288] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:20.767145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789add1b-c072-4365-868d-9fbf917de876 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:20.767145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789add1b-c072-4365-868d-9fbf917de876 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:20.767145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789add1b-c072-4365-868d-9fbf917de876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:20.784573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-789add1b-c072-4365-868d-9fbf917de876 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:20.785793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-789add1b-c072-4365-868d-9fbf917de876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:20.815008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:20.849667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 643/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:24:20.872291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22002aa-02f9-4ce1-b853-4969189504d7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:20.972151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22002aa-02f9-4ce1-b853-4969189504d7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:20.983528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:21.007475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:21.008112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:21.008540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:21.008848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:21.009470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:21.010839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:21.020000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:21.021276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:21.022323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 647/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:24:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:21.027169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789add1b-c072-4365-868d-9fbf917de876 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:21.125163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789add1b-c072-4365-868d-9fbf917de876 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:21.158436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:21.159047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:21.159332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:21.159608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:21.160278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:21.160586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:21.161965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c176c2-d590-4d0a-ad97-a5c57a439784 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:21.166705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 644/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Jul 27 08:24:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:21.173275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:21.272873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3651-e5d3-48af-b175-a04548818dfa None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:21.305262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:21.305867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:21.306142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:21.306409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] PATH_INFO: `/v3/services` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:21.307067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:21.307368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:21.308720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea27c-c117-458a-aca4-86ba6dc69736 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:21.312985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 648/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Jul 27 08:24:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:23.363015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509a8f6-3c30-4a8a-868d-8cb79abcb2cc None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:23.363691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509a8f6-3c30-4a8a-868d-8cb79abcb2cc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:23.363800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509a8f6-3c30-4a8a-868d-8cb79abcb2cc None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:23.365166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 645/1293] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:23.370625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9a1f-b014-4d9e-9d6b-4002a337bd02 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:23.371089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9a1f-b014-4d9e-9d6b-4002a337bd02 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:23.371182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9a1f-b014-4d9e-9d6b-4002a337bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:23.391859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9dea9a1f-b014-4d9e-9d6b-4002a337bd02 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:23.393523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9dea9a1f-b014-4d9e-9d6b-4002a337bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:23.431236 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:23.478931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 649/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:23.502929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509a8f6-3c30-4a8a-868d-8cb79abcb2cc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:23.547939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:23.626323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509a8f6-3c30-4a8a-868d-8cb79abcb2cc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:23.660269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c076e-9541-4c79-986f-a7458a1b067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:23.660921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c076e-9541-4c79-986f-a7458a1b067b None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:23.661211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c076e-9541-4c79-986f-a7458a1b067b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:23.661492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c076e-9541-4c79-986f-a7458a1b067b None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:23.662189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c076e-9541-4c79-986f-a7458a1b067b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:23.663558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c076e-9541-4c79-986f-a7458a1b067b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:23.746883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 646/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Jul 27 08:24:23 2022] POST /identity/v3/services => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:24:25.792432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ee1db-5b89-4370-bd3d-bbe960b64f5b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:25.792988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ee1db-5b89-4370-bd3d-bbe960b64f5b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:25.792988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ee1db-5b89-4370-bd3d-bbe960b64f5b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:25.794272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 650/1296] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:25.800006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:25.800428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:25.802661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:25.818429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:25.819616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:25.894464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 647/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:25.917116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ee1db-5b89-4370-bd3d-bbe960b64f5b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:26.017684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ee1db-5b89-4370-bd3d-bbe960b64f5b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:26.050256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:26.050825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:26.051189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:26.051368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:26.051977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:26.053370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:26.062572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:26.063767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:26.064695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 651/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:24:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:26.069807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:26.087566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:26.164606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab463b-7a8e-4b45-a494-144a181890f6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:26.197531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:26.198144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:26.198425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:26.198698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:26.199385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:26.199962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:26.202141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:26.207404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 648/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Jul 27 08:24:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:26.213530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:26.244484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:26.313863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a25c6d-9ff9-4e40-92bf-e3c216ce715f None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:26.346345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:26.346992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:26.347271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:26.347644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:26.348383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] RBAC: Adding query filter params (interface=public, service_id=3737dda992ed40a6aa6bb892aba909b7, region_id=RegionOne) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:26.348690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:26.350069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657f959-4bd4-4f2f-92e5-38a010439ff8 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:26.354983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 652/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Jul 27 08:24:26 2022] GET /identity/v3/endpoints?service_id=3737dda992ed40a6aa6bb892aba909b7&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:26.361373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:26.441745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:26.459943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e378e-98ca-484c-8eeb-6d4fb0d45358 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:26.494931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36182-a104-4d27-b1bb-a4c0cdf744c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:26.495553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36182-a104-4d27-b1bb-a4c0cdf744c6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:26.495836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36182-a104-4d27-b1bb-a4c0cdf744c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:26.496111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36182-a104-4d27-b1bb-a4c0cdf744c6 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:26.496796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36182-a104-4d27-b1bb-a4c0cdf744c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:26.498228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36182-a104-4d27-b1bb-a4c0cdf744c6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:26.505321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 649/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Jul 27 08:24:26 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:24:28.531743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa813-8ba0-4db4-9426-8384c2a9a74c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:28.532179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa813-8ba0-4db4-9426-8384c2a9a74c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:28.532331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa813-8ba0-4db4-9426-8384c2a9a74c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:28.533735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 653/1302] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:24:28.539044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:28.539501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:28.539723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:28.557822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:24:28.559008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:24:28.626266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 650/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:24:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:24:28.649903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa813-8ba0-4db4-9426-8384c2a9a74c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:28.743506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:28.750843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa813-8ba0-4db4-9426-8384c2a9a74c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:28.783451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:28.784333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:28.784617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:28.784919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:28.785530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:28.786878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:24:28.795382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:24:28.796569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application with Lock( Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: ERROR keystone.server.flask.application Jul 27 08:24:28.797783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 654/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Jul 27 08:24:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:24:28.803679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:28.877832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:28.899448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82083dd-9484-431e-9193-cd4cd41c512e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:28.931499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:28.932336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:28.933002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:28.933276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:28.933944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:24:28.934248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:28.936182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294a2ae-1566-4bf7-81cd-e9fd6be2622b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:28.941291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 651/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Jul 27 08:24:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:24:28.947182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:24:29.047211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e898-bf4d-4996-81c0-6510d51dbc07 None admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:24:29.080188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca939f-a5dd-4994-8627-6341487b53eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:24:29.080819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca939f-a5dd-4994-8627-6341487b53eb None admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:24:29.081105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca939f-a5dd-4994-8627-6341487b53eb None admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:24:29.081381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca939f-a5dd-4994-8627-6341487b53eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:24:29.082156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca939f-a5dd-4994-8627-6341487b53eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:24:29.083523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca939f-a5dd-4994-8627-6341487b53eb None admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:24:29.175296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 655/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:24:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:24:38.938401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=30 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:24:39.170345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:24.631234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393ea8-126b-4a16-89f6-5a28a58ce5d7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:24.631883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393ea8-126b-4a16-89f6-5a28a58ce5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:24.631883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393ea8-126b-4a16-89f6-5a28a58ce5d7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:24.638384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe09b97-c765-4ac2-b666-d97b67f2290b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:24.638846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe09b97-c765-4ac2-b666-d97b67f2290b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:24.638952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe09b97-c765-4ac2-b666-d97b67f2290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:24.643680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 652/1307] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:24.722586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ffe09b97-c765-4ac2-b666-d97b67f2290b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:24.724606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ffe09b97-c765-4ac2-b666-d97b67f2290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:24.846696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 656/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:30:24.924847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d032-8fd7-48d6-aac3-b35ec5dfbacd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:24.925530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d032-8fd7-48d6-aac3-b35ec5dfbacd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:24.926651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d032-8fd7-48d6-aac3-b35ec5dfbacd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:24.928502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 653/1309] 10.222.0.60 () {54 vars in 965 bytes} [Wed Jul 27 08:30:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:24.934545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b9c1-520c-4cfa-9c2e-ab31205c80c0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:24.934835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b9c1-520c-4cfa-9c2e-ab31205c80c0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:24.935113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b9c1-520c-4cfa-9c2e-ab31205c80c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:25.096928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9eb1b9c1-520c-4cfa-9c2e-ab31205c80c0 None None] MFA Rules not processed for user `aefebccee9e74e91a48485fa6f074698`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:25.098709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9eb1b9c1-520c-4cfa-9c2e-ab31205c80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:25.166954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:25.231485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 657/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Jul 27 08:30:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:25.240237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1d032-8fd7-48d6-aac3-b35ec5dfbacd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:25.242299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-41a1d032-8fd7-48d6-aac3-b35ec5dfbacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:25.395910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1d032-8fd7-48d6-aac3-b35ec5dfbacd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:25.496979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:25.497876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:25.498323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:25.498775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:25.501216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:25.576529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:25.639507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:25.641126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c6493-4faa-4113-b95d-f072d8560d6c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:25.682152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 654/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:28.112374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc233-b1e9-4268-a62d-0ab0af0e1b65 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:28.113036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc233-b1e9-4268-a62d-0ab0af0e1b65 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:28.113684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc233-b1e9-4268-a62d-0ab0af0e1b65 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:28.115114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 658/1312] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:28.120216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03290d38-7276-4acc-8b25-233ea6ee1cf3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:28.120679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03290d38-7276-4acc-8b25-233ea6ee1cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:28.121009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03290d38-7276-4acc-8b25-233ea6ee1cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:28.203817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-03290d38-7276-4acc-8b25-233ea6ee1cf3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:28.205108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-03290d38-7276-4acc-8b25-233ea6ee1cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:28.304665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 655/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:28.343280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dc233-b1e9-4268-a62d-0ab0af0e1b65 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:28.344830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-057dc233-b1e9-4268-a62d-0ab0af0e1b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:28.449037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dc233-b1e9-4268-a62d-0ab0af0e1b65 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:28.524490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:28.527070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:28.527716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:28.527996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:28.528305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:28.529959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:28.639085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:28.640527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd805af-425c-4cd5-ada6-c26a4c5b3c1a service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:28.659552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 659/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:31.150099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d212-b7ec-44df-9a8e-4a5fd3b6ec98 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:31.150615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d212-b7ec-44df-9a8e-4a5fd3b6ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:31.150724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d212-b7ec-44df-9a8e-4a5fd3b6ec98 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:31.152147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 656/1315] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:31.157414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b75b6-926b-4af2-8c6d-95f528c1058a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:31.157858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b75b6-926b-4af2-8c6d-95f528c1058a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:31.157955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b75b6-926b-4af2-8c6d-95f528c1058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:31.230862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5a7b75b6-926b-4af2-8c6d-95f528c1058a None None] MFA Rules not processed for user `0d3280fb30b44a0285cf3806c6ddee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:31.232070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5a7b75b6-926b-4af2-8c6d-95f528c1058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:31.285548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:31.331354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 660/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:31.372197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345d212-b7ec-44df-9a8e-4a5fd3b6ec98 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:31.373791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3345d212-b7ec-44df-9a8e-4a5fd3b6ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:31.384998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:31.483942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345d212-b7ec-44df-9a8e-4a5fd3b6ec98 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:31.561855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:31.562471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:31.562849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:31.563125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:31.564785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:31.631479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:31.679484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:31.680958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba65d21-1512-4296-9dcb-cea0c66c5191 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:31.700258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 657/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:34.582810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e2cc-fc0a-41c9-a0dd-65667565aa1f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:34.583342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e2cc-fc0a-41c9-a0dd-65667565aa1f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:34.583434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e2cc-fc0a-41c9-a0dd-65667565aa1f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:34.584818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 661/1318] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:34.590096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ffb2a-dfcc-4ec7-8f2f-c1f8d52379c1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:34.590572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ffb2a-dfcc-4ec7-8f2f-c1f8d52379c1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:34.590682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ffb2a-dfcc-4ec7-8f2f-c1f8d52379c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:34.658162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e85ffb2a-dfcc-4ec7-8f2f-c1f8d52379c1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:34.659379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e85ffb2a-dfcc-4ec7-8f2f-c1f8d52379c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:34.761193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 658/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:34.812207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f841d2-c811-4138-b622-0c54e70dff52 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:34.812517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f841d2-c811-4138-b622-0c54e70dff52 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:34.812817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f841d2-c811-4138-b622-0c54e70dff52 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:34.814176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 662/1320] 10.222.0.60 () {54 vars in 965 bytes} [Wed Jul 27 08:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:34.820411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1309-22ba-4bbb-991e-c68a13daaf1b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:34.820702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1309-22ba-4bbb-991e-c68a13daaf1b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:34.821004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f1309-22ba-4bbb-991e-c68a13daaf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:34.844227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:34.900601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-167f1309-22ba-4bbb-991e-c68a13daaf1b None None] MFA Rules not processed for user `aefebccee9e74e91a48485fa6f074698`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:34.901887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-167f1309-22ba-4bbb-991e-c68a13daaf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:34.981219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 659/1321] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Jul 27 08:30:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:34.990447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f841d2-c811-4138-b622-0c54e70dff52 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:34.991972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a6f841d2-c811-4138-b622-0c54e70dff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:35.102626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f841d2-c811-4138-b622-0c54e70dff52 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:35.178659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:35.179372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:35.179659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:35.179937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:35.181613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:35.189884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:35.295261 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:35.296711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58354-c1b9-4dad-96fb-f20c0e77e6e6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:35.315610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 663/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:38.813282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1208805-228c-4c8b-881f-4261f628f12b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:38.813851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1208805-228c-4c8b-881f-4261f628f12b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:38.813851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1208805-228c-4c8b-881f-4261f628f12b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:38.815380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 660/1323] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:38.821094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaccf1-0416-4748-9e47-36c2b13e449e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:38.821527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaccf1-0416-4748-9e47-36c2b13e449e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:38.821636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaccf1-0416-4748-9e47-36c2b13e449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:38.888003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-babaccf1-0416-4748-9e47-36c2b13e449e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:38.889231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-babaccf1-0416-4748-9e47-36c2b13e449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:38.945684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:38.985147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 664/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:39.022664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1208805-228c-4c8b-881f-4261f628f12b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:39.024202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d1208805-228c-4c8b-881f-4261f628f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:39.134939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1208805-228c-4c8b-881f-4261f628f12b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:39.147546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:39.215872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:39.216504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:39.216836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:39.217117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:39.218800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:39.337831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:39.339276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686b088-6aeb-4aae-9a67-908e3beb0e78 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:39.357602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 661/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:41.439939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057415e-5fbc-4278-9e7a-9c262d64421f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:41.440508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057415e-5fbc-4278-9e7a-9c262d64421f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:41.440508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057415e-5fbc-4278-9e7a-9c262d64421f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:41.441912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 665/1326] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:41.447131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8e09-1531-4526-9340-4d0b24f6af7f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:41.447569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8e09-1531-4526-9340-4d0b24f6af7f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:41.447845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8e09-1531-4526-9340-4d0b24f6af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:41.496143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:41.517438 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-946c8e09-1531-4526-9340-4d0b24f6af7f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:41.519303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-946c8e09-1531-4526-9340-4d0b24f6af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:41.615377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 662/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:41.653546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057415e-5fbc-4278-9e7a-9c262d64421f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:41.655021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a057415e-5fbc-4278-9e7a-9c262d64421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:41.759006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057415e-5fbc-4278-9e7a-9c262d64421f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:41.830542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:41.831750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:41.832031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:41.832296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:41.833939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:41.850372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:41.941187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:41.942605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97190ebe-78b7-41e1-ada1-41fa60427b16 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:41.961075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 666/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:44.054699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fb531-80ee-42b2-9d3d-ed0757baf389 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:44.055266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fb531-80ee-42b2-9d3d-ed0757baf389 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:44.055266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fb531-80ee-42b2-9d3d-ed0757baf389 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:44.056622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 663/1329] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:44.061751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9a66-f3bf-4822-86a2-6593e4442719 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:44.062160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9a66-f3bf-4822-86a2-6593e4442719 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:44.062313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9a66-f3bf-4822-86a2-6593e4442719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:44.128153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-aaec9a66-f3bf-4822-86a2-6593e4442719 None None] MFA Rules not processed for user `0d3280fb30b44a0285cf3806c6ddee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:44.129490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-aaec9a66-f3bf-4822-86a2-6593e4442719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:44.193444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:44.229063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 667/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:44.267119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fb531-80ee-42b2-9d3d-ed0757baf389 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:44.269307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-166fb531-80ee-42b2-9d3d-ed0757baf389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:44.373507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fb531-80ee-42b2-9d3d-ed0757baf389 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:44.394011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:44.451110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:44.451755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:44.452041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:44.452314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:44.453995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:44.569368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:44.570797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355de8eb-91fd-4fac-8603-adfd5e436894 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:44.589044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 664/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:47.049504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e882-1ed9-46a3-a45f-7e5993f5528e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:47.050069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e882-1ed9-46a3-a45f-7e5993f5528e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:47.050361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e882-1ed9-46a3-a45f-7e5993f5528e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:47.051737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 668/1332] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:47.057001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3be67-09d4-4015-ac74-7cec02f0ff11 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:47.057453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3be67-09d4-4015-ac74-7cec02f0ff11 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:47.057568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3be67-09d4-4015-ac74-7cec02f0ff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:47.123668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:47.126759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-26e3be67-09d4-4015-ac74-7cec02f0ff11 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:47.128610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-26e3be67-09d4-4015-ac74-7cec02f0ff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:47.227348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 665/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:47.264960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7e882-1ed9-46a3-a45f-7e5993f5528e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:47.266502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a8d7e882-1ed9-46a3-a45f-7e5993f5528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:47.368043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7e882-1ed9-46a3-a45f-7e5993f5528e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:47.439813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:47.441201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:47.441487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:47.441762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:47.443364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:47.468822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:47.550606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:47.552045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751320f-b884-4864-88d5-f57508f990b3 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:47.569533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 669/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:49.618099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c2d8-4601-4f98-8b55-8756d3150e12 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:49.618618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c2d8-4601-4f98-8b55-8756d3150e12 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:49.618713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c2d8-4601-4f98-8b55-8756d3150e12 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:49.620010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 666/1335] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:49.625689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ab14c-123e-4770-80eb-57b62ff54e4d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:49.626092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ab14c-123e-4770-80eb-57b62ff54e4d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:49.626242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ab14c-123e-4770-80eb-57b62ff54e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:49.691154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f69ab14c-123e-4770-80eb-57b62ff54e4d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:49.692340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f69ab14c-123e-4770-80eb-57b62ff54e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:49.766498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:49.788453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 670/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:49.829747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c2d8-4601-4f98-8b55-8756d3150e12 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:49.831288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-36f4c2d8-4601-4f98-8b55-8756d3150e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:49.935110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c2d8-4601-4f98-8b55-8756d3150e12 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:49.962377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:50.009164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:50.009782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:50.010067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:50.010347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:50.012115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:50.118062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:50.119414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c7cb4-6d1a-4e4a-b22f-76aaedb311ee service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:50.138154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 667/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:52.795500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c52171-e028-4e53-929f-4e3bd274c97f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:52.796024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c52171-e028-4e53-929f-4e3bd274c97f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:52.796024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c52171-e028-4e53-929f-4e3bd274c97f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:52.797357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 671/1338] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:52.802558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18778-f9b8-48a1-b2a9-5164379fe869 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:52.802975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18778-f9b8-48a1-b2a9-5164379fe869 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:52.803143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18778-f9b8-48a1-b2a9-5164379fe869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:52.868735 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-48b18778-f9b8-48a1-b2a9-5164379fe869 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:52.869980 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-48b18778-f9b8-48a1-b2a9-5164379fe869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:52.879041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:52.966900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 668/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:30:53.003734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c52171-e028-4e53-929f-4e3bd274c97f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:53.005307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e8c52171-e028-4e53-929f-4e3bd274c97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:53.108030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c52171-e028-4e53-929f-4e3bd274c97f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:53.181614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:53.182246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:53.182525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:53.182799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:53.184448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:53.221815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:53.294485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:53.295934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab673bbb-2c4f-423e-b398-06e7ea0a30ac service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:53.314901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 672/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:30:57.462914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b45c6-6e76-45e5-8578-02fc9b78e329 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:57.463528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b45c6-6e76-45e5-8578-02fc9b78e329 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:57.463528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b45c6-6e76-45e5-8578-02fc9b78e329 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:57.464883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 669/1341] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:30:57.470211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727823-207c-4818-b928-6e76768f640d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:57.472119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727823-207c-4818-b928-6e76768f640d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:57.472119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727823-207c-4818-b928-6e76768f640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:57.550771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a4727823-207c-4818-b928-6e76768f640d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:30:57.552594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a4727823-207c-4818-b928-6e76768f640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:57.644093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:57.655342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 673/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:30:57.694891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b45c6-6e76-45e5-8578-02fc9b78e329 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:30:57.696433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0f1b45c6-6e76-45e5-8578-02fc9b78e329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:57.803718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b45c6-6e76-45e5-8578-02fc9b78e329 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:30:57.843214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:30:57.880268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:30:57.880920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:30:57.881210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:30:57.881488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:30:57.883135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:30:57.993094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:30:57.994623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349432de-8788-44f2-aa20-9ef3402ee68a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:30:58.013988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 670/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:01.098145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d20b-45fa-4fb6-9474-3ab6bed16d06 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:01.098629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d20b-45fa-4fb6-9474-3ab6bed16d06 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:01.098724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d20b-45fa-4fb6-9474-3ab6bed16d06 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:01.100076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 674/1344] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:01.105310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc113-53d3-4c05-9c37-17f71fd8db18 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:01.105714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc113-53d3-4c05-9c37-17f71fd8db18 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:01.106038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc113-53d3-4c05-9c37-17f71fd8db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:01.173115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ac0dc113-53d3-4c05-9c37-17f71fd8db18 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:01.174835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ac0dc113-53d3-4c05-9c37-17f71fd8db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:01.193564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:01.273832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 671/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:01.311477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d20b-45fa-4fb6-9474-3ab6bed16d06 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:01.313173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c145d20b-45fa-4fb6-9474-3ab6bed16d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:01.420893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d20b-45fa-4fb6-9474-3ab6bed16d06 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:01.495149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:01.495765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:01.496044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:01.496766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:01.498423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:01.546696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:01.614902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:01.616352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8dad-52ab-4d16-8468-87aa0409056e service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:01.635187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 675/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:05.981948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcf6d2-228e-4b0b-9bdb-18139454526c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:05.982469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcf6d2-228e-4b0b-9bdb-18139454526c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:05.982591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcf6d2-228e-4b0b-9bdb-18139454526c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:05.983861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 672/1347] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:05.989839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc09a-3ea0-4761-ab2a-98e3adf13f7d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:05.990291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc09a-3ea0-4761-ab2a-98e3adf13f7d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:05.990384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc09a-3ea0-4761-ab2a-98e3adf13f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:06.061525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-610cc09a-3ea0-4761-ab2a-98e3adf13f7d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:06.062751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-610cc09a-3ea0-4761-ab2a-98e3adf13f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:06.161232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:06.163783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 676/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:06.204154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcf6d2-228e-4b0b-9bdb-18139454526c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:06.205917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c1fcf6d2-228e-4b0b-9bdb-18139454526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:06.316666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcf6d2-228e-4b0b-9bdb-18139454526c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:06.364664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:06.390266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:06.391063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:06.391557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:06.392116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:06.393923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:06.499473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:06.500939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b248c-7c36-40d9-8c54-acf44b016746 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:06.520503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 673/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:11.433389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0cf3-ed02-43ac-88bc-f9e195874db9 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:11.434438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0cf3-ed02-43ac-88bc-f9e195874db9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:11.434885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0cf3-ed02-43ac-88bc-f9e195874db9 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:11.436367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 677/1350] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:11.442321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b181-3dd4-45ca-9f62-4a8dd2a9f3bd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:11.442760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b181-3dd4-45ca-9f62-4a8dd2a9f3bd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:11.442945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b181-3dd4-45ca-9f62-4a8dd2a9f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:11.574293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-81b1b181-3dd4-45ca-9f62-4a8dd2a9f3bd None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:11.575517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-81b1b181-3dd4-45ca-9f62-4a8dd2a9f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:11.603782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:11.695576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 674/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:15.886028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c47f9-1c56-4767-81a2-14ae7c5bf3e5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:15.886593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c47f9-1c56-4767-81a2-14ae7c5bf3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:15.886677 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c47f9-1c56-4767-81a2-14ae7c5bf3e5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:15.888491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 678/1352] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:15.894766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb072-78fb-474c-bfe0-7ca64dbe9e19 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:15.895698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb072-78fb-474c-bfe0-7ca64dbe9e19 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:15.896041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb072-78fb-474c-bfe0-7ca64dbe9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:15.975730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-85bfb072-78fb-474c-bfe0-7ca64dbe9e19 None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:15.976964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-85bfb072-78fb-474c-bfe0-7ca64dbe9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:16.052222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:16.094805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 675/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:31:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:17.418225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613f4-f38d-446e-848b-a3fe72b24266 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:17.418744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613f4-f38d-446e-848b-a3fe72b24266 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:17.418744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613f4-f38d-446e-848b-a3fe72b24266 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:17.420019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 679/1354] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:17.425732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4812-5a00-4b7e-92a3-0484d32f6c34 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:17.426151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4812-5a00-4b7e-92a3-0484d32f6c34 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:17.426294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4812-5a00-4b7e-92a3-0484d32f6c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:17.503098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-81de4812-5a00-4b7e-92a3-0484d32f6c34 None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:17.504291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-81de4812-5a00-4b7e-92a3-0484d32f6c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:17.616861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 676/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:31:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:20.903096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fab7b-15ea-447b-ba11-b86fd04ad916 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:20.903623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fab7b-15ea-447b-ba11-b86fd04ad916 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:20.903623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fab7b-15ea-447b-ba11-b86fd04ad916 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:20.905040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 680/1356] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:20.911164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae308a8-cbfa-4f60-b37e-bd2043305485 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:20.911594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae308a8-cbfa-4f60-b37e-bd2043305485 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:20.911767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae308a8-cbfa-4f60-b37e-bd2043305485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:20.949938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:20.986287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1ae308a8-cbfa-4f60-b37e-bd2043305485 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:20.987508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1ae308a8-cbfa-4f60-b37e-bd2043305485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:21.092183 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 677/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:21.148634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910680aa-052c-4945-9538-cf918ab9395b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:21.149409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910680aa-052c-4945-9538-cf918ab9395b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:21.149687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910680aa-052c-4945-9538-cf918ab9395b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:21.151020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 681/1358] 10.222.0.60 () {54 vars in 962 bytes} [Wed Jul 27 08:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:21.159662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b3cbc-ff0a-4ef8-a381-c60610b40568 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:21.159951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b3cbc-ff0a-4ef8-a381-c60610b40568 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:21.160234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b3cbc-ff0a-4ef8-a381-c60610b40568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:21.252184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ff4b3cbc-ff0a-4ef8-a381-c60610b40568 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:21.253795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ff4b3cbc-ff0a-4ef8-a381-c60610b40568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:21.305421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:21.375302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 678/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Jul 27 08:31:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:31:21.383796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910680aa-052c-4945-9538-cf918ab9395b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:21.385417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-910680aa-052c-4945-9538-cf918ab9395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:21.543006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910680aa-052c-4945-9538-cf918ab9395b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:21.626295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:21.683971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:21.684894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:21.685327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:21.685832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:21.687886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:21.808975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:21.810879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f7e06-8b75-4099-9a57-6b6b9eff9817 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:21.832300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 682/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:24.075567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72a112-844a-4d26-8a3d-1dba11e84000 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:24.076086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72a112-844a-4d26-8a3d-1dba11e84000 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:24.076086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72a112-844a-4d26-8a3d-1dba11e84000 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:24.079286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 679/1361] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:24.083196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2292f-4660-46ca-b1a2-933a2c4c7922 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:24.083663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2292f-4660-46ca-b1a2-933a2c4c7922 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:24.083772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2292f-4660-46ca-b1a2-933a2c4c7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:24.160545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-65c2292f-4660-46ca-b1a2-933a2c4c7922 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:24.161977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-65c2292f-4660-46ca-b1a2-933a2c4c7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:24.202885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:24.269134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 683/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:24.314537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72a112-844a-4d26-8a3d-1dba11e84000 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:24.316390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bb72a112-844a-4d26-8a3d-1dba11e84000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:24.514318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72a112-844a-4d26-8a3d-1dba11e84000 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:24.523795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:24.646098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:24.646879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:24.647300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:24.647791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:24.649729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:24.744627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:24.746439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14c3aa-a4e9-4bf9-bfc1-5c675dca9a0e service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:24.766879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 680/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:27.257089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b077-351c-4349-87bf-c9dafc42dbdd None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:27.258035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b077-351c-4349-87bf-c9dafc42dbdd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:27.258035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900b077-351c-4349-87bf-c9dafc42dbdd None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:27.259388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 684/1364] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:27.269316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb852c-d622-427f-b880-7079942a0134 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:27.269849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb852c-d622-427f-b880-7079942a0134 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:27.270273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb852c-d622-427f-b880-7079942a0134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:27.290688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:27.360194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a9cb852c-d622-427f-b880-7079942a0134 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:27.361751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a9cb852c-d622-427f-b880-7079942a0134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:27.477441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 681/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:27.529591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928ba75-bd11-482a-bc23-4c93cf3bcb27 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:27.530153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928ba75-bd11-482a-bc23-4c93cf3bcb27 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:27.530422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928ba75-bd11-482a-bc23-4c93cf3bcb27 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:27.531969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 685/1366] 10.222.0.60 () {54 vars in 962 bytes} [Wed Jul 27 08:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:31:27.538393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0e9b5-800b-4bd4-829a-bf65ef003ae4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:27.538680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0e9b5-800b-4bd4-829a-bf65ef003ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:27.538962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0e9b5-800b-4bd4-829a-bf65ef003ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:27.625532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a7e0e9b5-800b-4bd4-829a-bf65ef003ae4 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:27.627550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a7e0e9b5-800b-4bd4-829a-bf65ef003ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:27.666291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:27.755575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 682/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Jul 27 08:31:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:27.767494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928ba75-bd11-482a-bc23-4c93cf3bcb27 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:27.769058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b928ba75-bd11-482a-bc23-4c93cf3bcb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:27.927010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928ba75-bd11-482a-bc23-4c93cf3bcb27 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:27.948521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:28.047692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:28.048260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:28.048536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:28.048838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:28.050455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:28.149281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:28.151165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fb291-ee45-47e9-a2c3-1f7525cb1090 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:28.170796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 686/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:31:29.109763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173f51-1571-4357-a409-4caab8b389d8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:29.110868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173f51-1571-4357-a409-4caab8b389d8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:29.110868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98173f51-1571-4357-a409-4caab8b389d8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:29.112861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 683/1369] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:29.117796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacdea6-cb5d-4f23-82c2-9678dcd9a588 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:29.118215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacdea6-cb5d-4f23-82c2-9678dcd9a588 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:29.118306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacdea6-cb5d-4f23-82c2-9678dcd9a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:29.153302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:29.190014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ddacdea6-cb5d-4f23-82c2-9678dcd9a588 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:29.191221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ddacdea6-cb5d-4f23-82c2-9678dcd9a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:29.300198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 687/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:29.640294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1f45-b452-496d-8843-6fc590c7b2f3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:29.640577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1f45-b452-496d-8843-6fc590c7b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:29.640880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1f45-b452-496d-8843-6fc590c7b2f3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:29.643008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 684/1371] 10.222.0.60 () {54 vars in 964 bytes} [Wed Jul 27 08:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:29.648008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075849-6450-44b0-998c-7bb34faecf1a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:29.648299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075849-6450-44b0-998c-7bb34faecf1a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:29.648578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075849-6450-44b0-998c-7bb34faecf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:29.726831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c7075849-6450-44b0-998c-7bb34faecf1a None None] MFA Rules not processed for user `9f29724574eb4370a0f60e2a612401cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:29.728039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c7075849-6450-44b0-998c-7bb34faecf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:29.779707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:29.810942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 688/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Jul 27 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:29.819473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1f45-b452-496d-8843-6fc590c7b2f3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:29.821214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b37d1f45-b452-496d-8843-6fc590c7b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:29.934004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1f45-b452-496d-8843-6fc590c7b2f3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:29.978873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:30.019240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:30.020038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:30.020464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:30.020935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:30.022770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:30.149040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:30.150578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688770e5-c081-4ba1-9ce0-fe79a0ed8bfc service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:30.175161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 685/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:30.431292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c459-72f5-49ac-bbd2-4fa0f8e60e61 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:30.432265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c459-72f5-49ac-bbd2-4fa0f8e60e61 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:30.432265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c459-72f5-49ac-bbd2-4fa0f8e60e61 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:30.433280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 689/1374] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:30.438756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e74-09c1-4ed6-a4ed-319a096d475b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:30.439056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e74-09c1-4ed6-a4ed-319a096d475b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:30.439354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e74-09c1-4ed6-a4ed-319a096d475b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:30.514518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c70d1e74-09c1-4ed6-a4ed-319a096d475b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:30.515720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c70d1e74-09c1-4ed6-a4ed-319a096d475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:30.536886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:30.612506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 686/1375] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:30.656982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c459-72f5-49ac-bbd2-4fa0f8e60e61 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:30.658496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7449c459-72f5-49ac-bbd2-4fa0f8e60e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:30.802133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c459-72f5-49ac-bbd2-4fa0f8e60e61 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:30.856494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:30.919185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:30.919806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:30.920088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:30.920359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:30.922053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:31.013736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:31.015337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617fe08-8312-4c8f-8538-cb3e8c2c5518 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:31.034019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 690/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:33.182336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495362c-ed8b-4638-b772-4a75a4dbce15 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:33.182863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495362c-ed8b-4638-b772-4a75a4dbce15 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:33.182981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495362c-ed8b-4638-b772-4a75a4dbce15 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:33.184309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 687/1377] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:33.189764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51aed3-8e00-49d7-b71f-b7a4795b13ee None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:33.190187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51aed3-8e00-49d7-b71f-b7a4795b13ee None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:33.190313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51aed3-8e00-49d7-b71f-b7a4795b13ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:33.273347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fc51aed3-8e00-49d7-b71f-b7a4795b13ee None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:33.274847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fc51aed3-8e00-49d7-b71f-b7a4795b13ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:33.282297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:33.386158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 691/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:33.430423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495362c-ed8b-4638-b772-4a75a4dbce15 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:33.432108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c495362c-ed8b-4638-b772-4a75a4dbce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:33.581241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495362c-ed8b-4638-b772-4a75a4dbce15 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:33.585099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:33.704797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:33.705395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:33.705808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:33.706094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:33.707757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:33.820262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:33.821844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42266e2b-171f-4218-b704-e2b17e3fdacf service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:33.844154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 688/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:36.034548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226aa5-ac6d-4a4a-934d-e370908e5c85 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:36.035125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226aa5-ac6d-4a4a-934d-e370908e5c85 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:36.035125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226aa5-ac6d-4a4a-934d-e370908e5c85 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:36.036574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 692/1380] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:36.041544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424784e3-f235-477b-a59a-55bd94305f95 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:36.041947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424784e3-f235-477b-a59a-55bd94305f95 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:36.042127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424784e3-f235-477b-a59a-55bd94305f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:36.054090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:36.111309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-424784e3-f235-477b-a59a-55bd94305f95 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:36.112510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-424784e3-f235-477b-a59a-55bd94305f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:36.222248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 689/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:36.267820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77226aa5-ac6d-4a4a-934d-e370908e5c85 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:36.269590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-77226aa5-ac6d-4a4a-934d-e370908e5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:36.419507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:36.431546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77226aa5-ac6d-4a4a-934d-e370908e5c85 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:36.563643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:36.564442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:36.564860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:36.565234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:36.566959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:36.677806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:36.679504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21679c-8a52-49fa-a0a7-ac25341313c8 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:36.692177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:36.700786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 693/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:38.995014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3141f-c68c-4831-b9a4-a58613fdc62d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:38.995559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3141f-c68c-4831-b9a4-a58613fdc62d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:38.995670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3141f-c68c-4831-b9a4-a58613fdc62d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:38.997310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 690/1383] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:39.004396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebf58-a588-464e-8324-3dde44d24652 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:39.004840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebf58-a588-464e-8324-3dde44d24652 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:39.005105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebf58-a588-464e-8324-3dde44d24652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:39.076181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-97aebf58-a588-464e-8324-3dde44d24652 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:39.077414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97aebf58-a588-464e-8324-3dde44d24652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:39.173026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 694/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:39.216667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3141f-c68c-4831-b9a4-a58613fdc62d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:39.218228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-53f3141f-c68c-4831-b9a4-a58613fdc62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:39.304068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:39.372340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3141f-c68c-4831-b9a4-a58613fdc62d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:39.501938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:39.502840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:39.503293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:39.504103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:39.506172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:39.564400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:39.606064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:39.607667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e910ecb-efed-4724-a82d-73378f8453a4 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:39.627056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 691/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:42.394901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29538d-4439-44c6-a9a6-0545ce929562 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:42.395496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29538d-4439-44c6-a9a6-0545ce929562 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:42.395496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29538d-4439-44c6-a9a6-0545ce929562 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:42.396831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 695/1386] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:42.403282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d61429-22b3-4106-a94a-9db66aeb7f15 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:42.403915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d61429-22b3-4106-a94a-9db66aeb7f15 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:42.403915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d61429-22b3-4106-a94a-9db66aeb7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:42.481682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c1d61429-22b3-4106-a94a-9db66aeb7f15 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:42.482961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c1d61429-22b3-4106-a94a-9db66aeb7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:42.581640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 692/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:42.646199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29538d-4439-44c6-a9a6-0545ce929562 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:42.647680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af29538d-4439-44c6-a9a6-0545ce929562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:42.726723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:42.796437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29538d-4439-44c6-a9a6-0545ce929562 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:42.917387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:42.918015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:42.918333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:42.918650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:42.920571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:42.973639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:43.034259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:43.037252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96bb82-bcc2-41bf-b146-194ccaf6952a service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:43.064026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 696/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:45.286965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2197f-15ef-4546-838e-3e5d8cbdd5e0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:45.287521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2197f-15ef-4546-838e-3e5d8cbdd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:45.287642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2197f-15ef-4546-838e-3e5d8cbdd5e0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:45.288992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 693/1389] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:45.294133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cf975-9db8-49f8-b6a3-fa3779830e4d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:45.294531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cf975-9db8-49f8-b6a3-fa3779830e4d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:45.294694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cf975-9db8-49f8-b6a3-fa3779830e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:45.367684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3c9cf975-9db8-49f8-b6a3-fa3779830e4d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:45.369375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3c9cf975-9db8-49f8-b6a3-fa3779830e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:45.471772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 697/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:45.518330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2197f-15ef-4546-838e-3e5d8cbdd5e0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:45.519843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e4e2197f-15ef-4546-838e-3e5d8cbdd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:45.550481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:45.679172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2197f-15ef-4546-838e-3e5d8cbdd5e0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:45.783142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:45.794852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:45.795484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:45.795769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:45.796048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:45.797846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:45.890020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:45.892192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fb4d6-7b14-41db-8a91-2986679d3499 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:45.910689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 694/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:48.021981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3519f7-69ba-4f80-b434-0e1197d2e629 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.022600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3519f7-69ba-4f80-b434-0e1197d2e629 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.022600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3519f7-69ba-4f80-b434-0e1197d2e629 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.023867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 698/1392] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:48.029059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff2f2-bcb0-453b-8d44-4fd0a0c5ded5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.029505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff2f2-bcb0-453b-8d44-4fd0a0c5ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.029682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff2f2-bcb0-453b-8d44-4fd0a0c5ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.098287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a4aff2f2-bcb0-453b-8d44-4fd0a0c5ded5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:48.099500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a4aff2f2-bcb0-453b-8d44-4fd0a0c5ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:48.158788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:48.196821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 695/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:48.199346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cae30-f84c-4d53-b68b-91e2adbf8f72 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.199642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cae30-f84c-4d53-b68b-91e2adbf8f72 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.199920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cae30-f84c-4d53-b68b-91e2adbf8f72 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.201365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 699/1394] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:48.206621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ebd1-27ec-4344-a158-2c1dcc669667 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.206912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ebd1-27ec-4344-a158-2c1dcc669667 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.207192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ebd1-27ec-4344-a158-2c1dcc669667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.242458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cae30-f84c-4d53-b68b-91e2adbf8f72 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:48.244039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-731cae30-f84c-4d53-b68b-91e2adbf8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:48.258176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:48.274311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9cc7ebd1-27ec-4344-a158-2c1dcc669667 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:48.275641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9cc7ebd1-27ec-4344-a158-2c1dcc669667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:48.373155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 696/1395] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:48.391837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cae30-f84c-4d53-b68b-91e2adbf8f72 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:48.431798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4c3c-cba1-4f0d-b48f-f6ac20cd877b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.432089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4c3c-cba1-4f0d-b48f-f6ac20cd877b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.432369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4c3c-cba1-4f0d-b48f-f6ac20cd877b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.437297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 697/1396] 10.222.0.60 () {54 vars in 966 bytes} [Wed Jul 27 08:31:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:31:48.438400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.438690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.438973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.482606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:48.493774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:48.511433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:48.511433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.511433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.511855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.518627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:48.518773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] MFA Rules not processed for user `1f9429e0cfd94f279a255fff511a4737`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:48.519985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:48.600793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 698/1397] 10.222.0.60 () {58 vars in 1063 bytes} [Wed Jul 27 08:31:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:48.606011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:48.607632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20425a90-400a-4f97-aeda-ab56bfa9fefa service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:48.608319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:48.616291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed39b3-7ee7-4496-bc9f-1c19522b62dc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:48.626403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 700/1398] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:31:48.694320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:48.694979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:48.695264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:48.695544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:48.697230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:48.760431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:48.817320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:48.818795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118d15-c086-4ec0-b130-c1de6559f6a2 service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:48.840066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 699/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:31:49.673693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07979fe7-af66-432b-b65f-f81051dec880 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:49.674176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07979fe7-af66-432b-b65f-f81051dec880 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:49.674281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07979fe7-af66-432b-b65f-f81051dec880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:49.741122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-07979fe7-af66-432b-b65f-f81051dec880 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:49.742364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-07979fe7-af66-432b-b65f-f81051dec880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:49.794424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:49.832525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 701/1400] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:31:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:49.877204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05400eb-949e-4a46-ba87-1e1544ccb0fe None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:49.877732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05400eb-949e-4a46-ba87-1e1544ccb0fe None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:49.877732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05400eb-949e-4a46-ba87-1e1544ccb0fe None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:49.879107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 700/1401] 10.222.0.60 () {54 vars in 943 bytes} [Wed Jul 27 08:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:49.885441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76841b-d246-42b3-a447-ba3981892f90 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:49.885733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76841b-d246-42b3-a447-ba3981892f90 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:49.886015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76841b-d246-42b3-a447-ba3981892f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:49.961177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8d76841b-d246-42b3-a447-ba3981892f90 None None] MFA Rules not processed for user `d4612a994b4a481bac7f122c9ebe8405`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:49.962658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8d76841b-d246-42b3-a447-ba3981892f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:50.068666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 702/1402] 10.222.0.60 () {58 vars in 1040 bytes} [Wed Jul 27 08:31:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:31:50.077794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05400eb-949e-4a46-ba87-1e1544ccb0fe None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:50.080079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b05400eb-949e-4a46-ba87-1e1544ccb0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:50.219827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05400eb-949e-4a46-ba87-1e1544ccb0fe None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:50.249689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:50.325598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:50.326212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:50.326493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:50.326766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:50.329286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:50.413721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:50.415338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a3488-bd3c-4678-a5b8-c0cfb17dfd50 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:50.423412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 701/1403] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:31:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:31:50.753721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77055f-4b16-4087-b744-ad8274da5246 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:50.754258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77055f-4b16-4087-b744-ad8274da5246 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:50.754258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77055f-4b16-4087-b744-ad8274da5246 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:50.755664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 703/1404] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:50.761080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d2a1-189c-4721-8028-bc8885ebc039 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:50.761400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d2a1-189c-4721-8028-bc8885ebc039 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:50.761709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d2a1-189c-4721-8028-bc8885ebc039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:50.841162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5a20d2a1-189c-4721-8028-bc8885ebc039 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:50.842402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5a20d2a1-189c-4721-8028-bc8885ebc039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:50.860254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:50.951722 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 702/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:50.996557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77055f-4b16-4087-b744-ad8274da5246 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:50.998624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3d77055f-4b16-4087-b744-ad8274da5246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:51.024761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:51.161840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77055f-4b16-4087-b744-ad8274da5246 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:51.268892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:51.286854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:51.287480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:51.287761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:51.288035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:51.289909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:51.390309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:51.392115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814983db-aff1-4db0-b298-7d020495c8a6 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:51.412611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 704/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:31:53.611597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e865-cda3-463e-b60d-2a4acd27e6cd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:53.612151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e865-cda3-463e-b60d-2a4acd27e6cd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:53.612151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e865-cda3-463e-b60d-2a4acd27e6cd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:53.613706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 703/1407] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:31:53.618717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e57ff8-9774-4611-b94c-6b5ad9855d44 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:53.619116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e57ff8-9774-4611-b94c-6b5ad9855d44 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:53.619275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e57ff8-9774-4611-b94c-6b5ad9855d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:53.693522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d4e57ff8-9774-4611-b94c-6b5ad9855d44 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:31:53.694822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d4e57ff8-9774-4611-b94c-6b5ad9855d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:53.757906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:53.804791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 705/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:31:53.854469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0e865-cda3-463e-b60d-2a4acd27e6cd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:31:53.856097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cac0e865-cda3-463e-b60d-2a4acd27e6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:54.019253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:54.024677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0e865-cda3-463e-b60d-2a4acd27e6cd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:31:54.147906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:31:54.148540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:31:54.148810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:31:54.149096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:31:54.150734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:31:54.256405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:31:54.258080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe9305-efc3-498d-99e7-ef5189350aa2 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:31:54.274938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:54.278384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 704/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:03.802695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=17 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:14.241118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9fe4-8fb0-4c72-a5e2-ac438ddc8e6b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:14.241783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9fe4-8fb0-4c72-a5e2-ac438ddc8e6b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:14.241783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9fe4-8fb0-4c72-a5e2-ac438ddc8e6b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:14.243223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 706/1410] 10.222.0.60 () {54 vars in 918 bytes} [Wed Jul 27 08:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:14.248842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495a49f-0bf8-4586-948c-f8bb34d0e390 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:14.249897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495a49f-0bf8-4586-948c-f8bb34d0e390 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:14.250079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495a49f-0bf8-4586-948c-f8bb34d0e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:14.331940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5495a49f-0bf8-4586-948c-f8bb34d0e390 None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:14.333198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5495a49f-0bf8-4586-948c-f8bb34d0e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:14.443937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 705/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Jul 27 08:32:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:14.458573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7623-b0e6-4ee4-8b4a-7f29a59240e7 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:14.458856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7623-b0e6-4ee4-8b4a-7f29a59240e7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:14.459131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7623-b0e6-4ee4-8b4a-7f29a59240e7 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:14.460511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 707/1412] 10.222.0.60 () {54 vars in 918 bytes} [Wed Jul 27 08:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:14.465365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd026f-2416-42b2-8760-082b2d610db6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:14.465666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd026f-2416-42b2-8760-082b2d610db6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:14.465948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd026f-2416-42b2-8760-082b2d610db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:14.545227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:14.548524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e0cd026f-2416-42b2-8760-082b2d610db6 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:14.549806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0cd026f-2416-42b2-8760-082b2d610db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:14.670244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 706/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Jul 27 08:32:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:17.175692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714cebe-bfc2-48cc-be95-a61402fa8a86 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:17.176177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714cebe-bfc2-48cc-be95-a61402fa8a86 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:17.176291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714cebe-bfc2-48cc-be95-a61402fa8a86 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:17.177770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:17.182937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a537-58d0-4828-a45b-ed742425b81a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:17.183378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a537-58d0-4828-a45b-ed742425b81a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:17.183487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a537-58d0-4828-a45b-ed742425b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:17.253002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1cf9a537-58d0-4828-a45b-ed742425b81a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:17.254236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1cf9a537-58d0-4828-a45b-ed742425b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:17.313093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:17.356879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:32:17.398800 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714cebe-bfc2-48cc-be95-a61402fa8a86 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:17.400263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9714cebe-bfc2-48cc-be95-a61402fa8a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:17.547557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714cebe-bfc2-48cc-be95-a61402fa8a86 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:17.619659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:17.659970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:17.660512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:17.660814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:17.661087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:17.662690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:17.752284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:17.753906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262256-5c2d-4d84-8750-d326cd63a23d service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:17.771248 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 709/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:18.680538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81f75-306e-4a92-a598-78e1baa279e0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:18.681132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81f75-306e-4a92-a598-78e1baa279e0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:18.681132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81f75-306e-4a92-a598-78e1baa279e0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:18.682530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:18.687464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f067a-a68a-4bec-9484-b573b1328b1e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:18.687909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f067a-a68a-4bec-9484-b573b1328b1e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:18.688012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f067a-a68a-4bec-9484-b573b1328b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:18.766608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e35f067a-a68a-4bec-9484-b573b1328b1e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:18.767740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e35f067a-a68a-4bec-9484-b573b1328b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:18.795802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:18.867529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:19.020249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81f75-306e-4a92-a598-78e1baa279e0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:19.021747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fab81f75-306e-4a92-a598-78e1baa279e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:19.165827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81f75-306e-4a92-a598-78e1baa279e0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:19.206637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:19.281202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:19.281738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:19.282017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:19.282288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:19.283900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:19.371287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:19.373157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c489003-84d2-483d-be82-a461bd3f4048 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:19.391391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 709/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:20.281395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4d15-9d63-4f2b-b546-170c65cbd46e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:20.281968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4d15-9d63-4f2b-b546-170c65cbd46e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:20.281968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4d15-9d63-4f2b-b546-170c65cbd46e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:20.283306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:20.288184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b2ca-f6e6-4704-a114-fe36eee68230 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:20.288587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b2ca-f6e6-4704-a114-fe36eee68230 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:20.288767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b2ca-f6e6-4704-a114-fe36eee68230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:20.343337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:20.485873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9aa1b2ca-f6e6-4704-a114-fe36eee68230 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:20.487109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9aa1b2ca-f6e6-4704-a114-fe36eee68230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:20.584070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:20.741294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4d15-9d63-4f2b-b546-170c65cbd46e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:20.743229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-339c4d15-9d63-4f2b-b546-170c65cbd46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:20.890326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4d15-9d63-4f2b-b546-170c65cbd46e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:20.904845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:21.005492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:21.006110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:21.006390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:21.006664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:21.008327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:21.097745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:21.099357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4a6fe-b845-4964-b93b-7a91b7ac3b78 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:21.117122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 712/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:21.982710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345e4bc-2499-415d-878d-38e4a761592f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:21.983258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345e4bc-2499-415d-878d-38e4a761592f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:21.983588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345e4bc-2499-415d-878d-38e4a761592f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:21.985032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:21.989960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952c9f-4779-42ec-bcd7-2e279b66af90 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:21.990426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952c9f-4779-42ec-bcd7-2e279b66af90 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:21.990541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952c9f-4779-42ec-bcd7-2e279b66af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:22.011098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:22.067734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-96952c9f-4779-42ec-bcd7-2e279b66af90 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:22.068977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-96952c9f-4779-42ec-bcd7-2e279b66af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:22.165360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:22.320018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345e4bc-2499-415d-878d-38e4a761592f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:22.321491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1345e4bc-2499-415d-878d-38e4a761592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:22.431130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:22.468091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345e4bc-2499-415d-878d-38e4a761592f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:22.579820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:22.580360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:22.580639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:22.580940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:22.582548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:22.657709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:22.671760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:22.674891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f90e2-fcdf-4c8f-9c7f-766372ecab72 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:22.692573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 712/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:23.603138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcf4b3-79ac-4b1c-937b-9446f2e228b8 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:23.603661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcf4b3-79ac-4b1c-937b-9446f2e228b8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:23.603661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcf4b3-79ac-4b1c-937b-9446f2e228b8 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:23.604993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:23.610696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9930-a5e1-454e-9b5b-cc1384f96753 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:23.611150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9930-a5e1-454e-9b5b-cc1384f96753 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:23.611248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9930-a5e1-454e-9b5b-cc1384f96753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:23.687554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d67a9930-a5e1-454e-9b5b-cc1384f96753 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:23.688804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d67a9930-a5e1-454e-9b5b-cc1384f96753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:23.783464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:32:23.940562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcf4b3-79ac-4b1c-937b-9446f2e228b8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:23.942118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbdcf4b3-79ac-4b1c-937b-9446f2e228b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:24.026189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:24.089235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcf4b3-79ac-4b1c-937b-9446f2e228b8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:24.202732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:24.203263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:24.203542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:24.203814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:24.205481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:24.259366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:24.299450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:24.301112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba7e93-6bdc-4ca5-9e8f-2e670e235f4d service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:24.319772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 715/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:25.213502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b280-dd87-4e5c-8aaa-e877ddbb2df5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:25.214054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b280-dd87-4e5c-8aaa-e877ddbb2df5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:25.214054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b280-dd87-4e5c-8aaa-e877ddbb2df5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:25.215343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:25.221347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ad2b-7b3b-4c6e-8104-f7b44aa51037 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:25.221813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ad2b-7b3b-4c6e-8104-f7b44aa51037 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:25.221928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64ad2b-7b3b-4c6e-8104-f7b44aa51037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:25.299611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4f64ad2b-7b3b-4c6e-8104-f7b44aa51037 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:25.300857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4f64ad2b-7b3b-4c6e-8104-f7b44aa51037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:25.398775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:25.549130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b280-dd87-4e5c-8aaa-e877ddbb2df5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:25.550712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-57e6b280-dd87-4e5c-8aaa-e877ddbb2df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:25.599813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:25.696588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b280-dd87-4e5c-8aaa-e877ddbb2df5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:25.809327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:25.809864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:25.810145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:25.810419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:25.812703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:25.819806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:25.903663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:25.905545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421345-835c-47a6-a511-38834f841f2d service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:25.923302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 715/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:26.789927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41954-2376-4638-9303-497af712044b None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:26.790446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41954-2376-4638-9303-497af712044b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:26.790446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a41954-2376-4638-9303-497af712044b None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:26.791737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:26.796818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdabeb9-e5e3-4b47-9879-a004c38d9595 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:26.797222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdabeb9-e5e3-4b47-9879-a004c38d9595 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:26.797396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdabeb9-e5e3-4b47-9879-a004c38d9595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:26.874268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0bdabeb9-e5e3-4b47-9879-a004c38d9595 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:26.875482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0bdabeb9-e5e3-4b47-9879-a004c38d9595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:26.953669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:26.983985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:32:27.151176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41954-2376-4638-9303-497af712044b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:27.152710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-55a41954-2376-4638-9303-497af712044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:27.171119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:27.307022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a41954-2376-4638-9303-497af712044b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:27.404903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:27.431633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:27.432403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:27.432684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:27.432996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:27.434639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:27.532171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:27.533817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cc4be-7b51-4026-bca1-c7e88def9981 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:27.551909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 718/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:32:28.434637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5595-7738-46a5-9be7-0ee95fbb11de None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:28.435217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5595-7738-46a5-9be7-0ee95fbb11de None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:28.435217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5595-7738-46a5-9be7-0ee95fbb11de None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:28.436797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:28.443259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53b53c-d9af-41a9-b5b2-ad8393692832 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:28.443690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53b53c-d9af-41a9-b5b2-ad8393692832 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:28.443813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53b53c-d9af-41a9-b5b2-ad8393692832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:28.519991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-eb53b53c-d9af-41a9-b5b2-ad8393692832 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:28.521250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eb53b53c-d9af-41a9-b5b2-ad8393692832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:28.562313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:28.616122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:32:28.768581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5595-7738-46a5-9be7-0ee95fbb11de None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:28.770131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d45a5595-7738-46a5-9be7-0ee95fbb11de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:28.911825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5595-7738-46a5-9be7-0ee95fbb11de None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:28.965484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:29.024430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36647-7182-4233-9ec9-206758843550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:29.025010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36647-7182-4233-9ec9-206758843550 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:29.025297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36647-7182-4233-9ec9-206758843550 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:29.025577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36647-7182-4233-9ec9-206758843550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:29.027196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-53a36647-7182-4233-9ec9-206758843550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:29.117786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36647-7182-4233-9ec9-206758843550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:29.119371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36647-7182-4233-9ec9-206758843550 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:29.137902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 718/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:30.032631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf91c7f-abed-46ce-abbf-fd5e8b599caa None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:30.033214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf91c7f-abed-46ce-abbf-fd5e8b599caa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:30.033214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf91c7f-abed-46ce-abbf-fd5e8b599caa None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:30.034595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:30.039395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d3466-4175-4507-92c1-ed5e7220acd3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:30.039831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d3466-4175-4507-92c1-ed5e7220acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:30.039929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d3466-4175-4507-92c1-ed5e7220acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:30.114562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d89d3466-4175-4507-92c1-ed5e7220acd3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:30.115761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d89d3466-4175-4507-92c1-ed5e7220acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:30.117813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:30.212346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:30.365352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf91c7f-abed-46ce-abbf-fd5e8b599caa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:30.366778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1bf91c7f-abed-46ce-abbf-fd5e8b599caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:30.513799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf91c7f-abed-46ce-abbf-fd5e8b599caa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:30.540132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:30.626178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:30.626723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:30.627002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:30.627272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:30.628926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:30.716760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:30.719138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3232-2204-4140-bb3f-f49cf5d7cc16 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:30.736844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 721/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:32.650815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f446b5-fa93-4d15-b993-15c653b1af21 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:32.651370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f446b5-fa93-4d15-b993-15c653b1af21 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:32.651370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f446b5-fa93-4d15-b993-15c653b1af21 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:32.652822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:32.658198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136978-b1e8-4ae7-a75b-19a4e9be59ec None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:32.658645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136978-b1e8-4ae7-a75b-19a4e9be59ec None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:32.658747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136978-b1e8-4ae7-a75b-19a4e9be59ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:32.698836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:32.724582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-62136978-b1e8-4ae7-a75b-19a4e9be59ec None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:32.726600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-62136978-b1e8-4ae7-a75b-19a4e9be59ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:32.820964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:32.860440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f446b5-fa93-4d15-b993-15c653b1af21 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:32.862063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e5f446b5-fa93-4d15-b993-15c653b1af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:32.965337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f446b5-fa93-4d15-b993-15c653b1af21 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:32.998684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:33.040784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:33.041381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:33.041660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:33.041932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:33.043555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:33.152215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:33.153650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cacb31-c907-49a4-8b49-c3e6c1f1d88b service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:33.173675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 721/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:35.328520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d2240-17e1-4312-a9ed-f2c082e27f87 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:35.329158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d2240-17e1-4312-a9ed-f2c082e27f87 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:35.329158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d2240-17e1-4312-a9ed-f2c082e27f87 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:35.330499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:35.335712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747aa54-2e97-4873-bd35-88b7df0dcf2c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:35.336156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747aa54-2e97-4873-bd35-88b7df0dcf2c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:35.336254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747aa54-2e97-4873-bd35-88b7df0dcf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:35.400610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4747aa54-2e97-4873-bd35-88b7df0dcf2c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:35.401824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4747aa54-2e97-4873-bd35-88b7df0dcf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:35.414412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:35.498994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:35.537891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d2240-17e1-4312-a9ed-f2c082e27f87 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:35.539415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e85d2240-17e1-4312-a9ed-f2c082e27f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:35.641974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d2240-17e1-4312-a9ed-f2c082e27f87 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:35.653831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:35.715405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:35.716023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:35.716307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:35.716582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:35.718746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:35.825881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:35.827991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd9836-97da-473c-9365-914b945f3956 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:35.846383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 724/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:38.222943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855034ff-7585-4e2c-b666-b615bdfbf44b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:38.223520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855034ff-7585-4e2c-b666-b615bdfbf44b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:38.223520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855034ff-7585-4e2c-b666-b615bdfbf44b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:38.224893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:38.230221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292432e-a0f1-4ccc-ad53-7de1c2097353 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:38.230688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292432e-a0f1-4ccc-ad53-7de1c2097353 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:38.230798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292432e-a0f1-4ccc-ad53-7de1c2097353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:38.278500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:38.295892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d292432e-a0f1-4ccc-ad53-7de1c2097353 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:38.297092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d292432e-a0f1-4ccc-ad53-7de1c2097353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:38.393205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:38.432624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855034ff-7585-4e2c-b666-b615bdfbf44b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:38.434179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-855034ff-7585-4e2c-b666-b615bdfbf44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:38.539144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855034ff-7585-4e2c-b666-b615bdfbf44b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:38.579154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:38.614464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:38.615081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:38.615367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:38.615645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:38.617295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:38.725328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:38.726774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da786ab7-3de0-471f-a34f-e8bc389c3f48 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:38.745634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 724/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:40.872467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f3a04-14a6-4612-9f0f-cb6fd9027661 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:40.873683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f3a04-14a6-4612-9f0f-cb6fd9027661 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:40.873683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f3a04-14a6-4612-9f0f-cb6fd9027661 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:40.874837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:40.880202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce23d3-4961-47d9-b57c-5b4fbb467bcc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:40.880622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce23d3-4961-47d9-b57c-5b4fbb467bcc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:40.880812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce23d3-4961-47d9-b57c-5b4fbb467bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:40.947134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-56ce23d3-4961-47d9-b57c-5b4fbb467bcc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:40.948349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-56ce23d3-4961-47d9-b57c-5b4fbb467bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:40.969031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:41.043852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:41.083577 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f3a04-14a6-4612-9f0f-cb6fd9027661 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:41.085156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1f0f3a04-14a6-4612-9f0f-cb6fd9027661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:41.187236 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f3a04-14a6-4612-9f0f-cb6fd9027661 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:41.206624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:41.261267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:41.261947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:41.262244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:41.262503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:41.264128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:41.374131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:41.375577 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1ccc8-aa9c-4fd8-944a-1d024da3d787 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:41.393281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 727/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:43.567280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e031-af82-4bc8-9df1-b097a829fb63 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:43.567817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e031-af82-4bc8-9df1-b097a829fb63 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:43.567817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e031-af82-4bc8-9df1-b097a829fb63 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:43.569215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:43.574484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31bc60-836f-4f07-8455-e34c02f5853c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:43.574926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31bc60-836f-4f07-8455-e34c02f5853c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:43.575039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31bc60-836f-4f07-8455-e34c02f5853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:43.638922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:43.641619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9f31bc60-836f-4f07-8455-e34c02f5853c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:43.642842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9f31bc60-836f-4f07-8455-e34c02f5853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:43.739635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:43.777785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e031-af82-4bc8-9df1-b097a829fb63 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:43.779823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b623e031-af82-4bc8-9df1-b097a829fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:43.882636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e031-af82-4bc8-9df1-b097a829fb63 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:43.931033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:43.956400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:43.957047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:43.957336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:43.957616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:43.959260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:44.066538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:44.067912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de99b5-b3b9-46ec-ba16-c787e4f4148b service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:44.086649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 727/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:46.164682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458df2d-5921-42e3-a2b2-f235f226da3e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:46.165304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458df2d-5921-42e3-a2b2-f235f226da3e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:46.165304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458df2d-5921-42e3-a2b2-f235f226da3e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:46.166621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:46.172781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ffe0-e036-480e-bc3c-ac29a52faed8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:46.173526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ffe0-e036-480e-bc3c-ac29a52faed8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:46.173804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ffe0-e036-480e-bc3c-ac29a52faed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:46.239854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1c30ffe0-e036-480e-bc3c-ac29a52faed8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:46.241110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1c30ffe0-e036-480e-bc3c-ac29a52faed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:46.269975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:46.342898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:46.380668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458df2d-5921-42e3-a2b2-f235f226da3e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:46.382252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e458df2d-5921-42e3-a2b2-f235f226da3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:46.484783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458df2d-5921-42e3-a2b2-f235f226da3e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:46.514581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:46.559960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:46.560579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:46.560893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:46.561171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:46.562798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:46.671376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:46.672867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d682def-2d17-4557-9ec8-ef0d0eed15da service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:46.690983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 730/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:48.765513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a30f-e20d-4576-95f9-a7bb63365fdb None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:48.766025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a30f-e20d-4576-95f9-a7bb63365fdb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:48.766025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660a30f-e20d-4576-95f9-a7bb63365fdb None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:48.767334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:48.772662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6b78-4f39-470e-a291-e2e7c0946904 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:48.773104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6b78-4f39-470e-a291-e2e7c0946904 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:48.773221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6b78-4f39-470e-a291-e2e7c0946904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:48.838886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-98fd6b78-4f39-470e-a291-e2e7c0946904 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:48.840083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-98fd6b78-4f39-470e-a291-e2e7c0946904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:48.849271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:48.937922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:48.976122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a30f-e20d-4576-95f9-a7bb63365fdb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:48.977719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8660a30f-e20d-4576-95f9-a7bb63365fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:49.082002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660a30f-e20d-4576-95f9-a7bb63365fdb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:49.136535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:49.155067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:49.155687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:49.155972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:49.156250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:49.157899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:49.265047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:49.266482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564978f-6b8e-4bb8-90f8-816298c17753 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:49.285329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 730/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:51.383802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457fd4c-adfd-49cb-881b-a4c983316ec3 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:51.384369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457fd4c-adfd-49cb-881b-a4c983316ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:51.384369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457fd4c-adfd-49cb-881b-a4c983316ec3 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:51.385790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:51.390993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5de09-f480-4060-8045-5a4a19fdeab1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:51.391424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5de09-f480-4060-8045-5a4a19fdeab1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:51.391558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5de09-f480-4060-8045-5a4a19fdeab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:51.456675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d0c5de09-f480-4060-8045-5a4a19fdeab1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:51.457818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d0c5de09-f480-4060-8045-5a4a19fdeab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:51.496876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:51.554597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:51.592933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457fd4c-adfd-49cb-881b-a4c983316ec3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:51.594465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c457fd4c-adfd-49cb-881b-a4c983316ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:51.701305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457fd4c-adfd-49cb-881b-a4c983316ec3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:51.739447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:51.775899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:51.776524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:51.776831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:51.777107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:51.778946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:51.885833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:51.887274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53b77-2fc4-4a54-963d-97e2a7a052de service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:51.904973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 733/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:53.942727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dedb0-3576-49d4-8d84-4b8128506893 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:53.943273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dedb0-3576-49d4-8d84-4b8128506893 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:53.943273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dedb0-3576-49d4-8d84-4b8128506893 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:53.944644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:53.949825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131046d-2d7c-4195-b287-ad8f15976854 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:53.950815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131046d-2d7c-4195-b287-ad8f15976854 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:53.950917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131046d-2d7c-4195-b287-ad8f15976854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:54.017267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3131046d-2d7c-4195-b287-ad8f15976854 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:54.018466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3131046d-2d7c-4195-b287-ad8f15976854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:54.036841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:54.236532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:54.274160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dedb0-3576-49d4-8d84-4b8128506893 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:54.275714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c70dedb0-3576-49d4-8d84-4b8128506893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:54.377960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dedb0-3576-49d4-8d84-4b8128506893 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:54.442909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:54.449511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:54.450794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:54.456766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:54.456766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:54.456766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:54.560642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:54.562090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd4c02-72c7-41f6-9c4d-93861bb4de5c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:54.580275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 733/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:56.619237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88cdd-6c3e-47be-8f6d-8430aa72f752 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:56.620160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88cdd-6c3e-47be-8f6d-8430aa72f752 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:56.620443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88cdd-6c3e-47be-8f6d-8430aa72f752 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:56.622484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:32:56.627800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60801f2-7cda-4a4e-85b7-423ac769a818 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:56.628627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60801f2-7cda-4a4e-85b7-423ac769a818 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:56.628951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60801f2-7cda-4a4e-85b7-423ac769a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:56.696869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a60801f2-7cda-4a4e-85b7-423ac769a818 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:32:56.698115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a60801f2-7cda-4a4e-85b7-423ac769a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:56.745469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:56.793665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:32:56.831014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf88cdd-6c3e-47be-8f6d-8430aa72f752 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:32:56.832543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eaf88cdd-6c3e-47be-8f6d-8430aa72f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:56.933386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf88cdd-6c3e-47be-8f6d-8430aa72f752 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:32:56.980172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:57.005111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:32:57.005730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:32:57.006006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:32:57.006336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:32:57.007950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:32:57.114193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:32:57.115548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b356af-593f-42d5-b58e-5c18ed03adc9 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:32:57.133212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 736/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:06.791737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=22 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:07.131029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=66 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:16.778530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99865804-6e8c-4d6b-933e-49ee9af7d82f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:16.779066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99865804-6e8c-4d6b-933e-49ee9af7d82f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:16.779066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99865804-6e8c-4d6b-933e-49ee9af7d82f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:16.780377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 735/1471] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:16.785528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03e44-0430-45c6-a1f0-203fdc0df355 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:16.785930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03e44-0430-45c6-a1f0-203fdc0df355 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:16.786072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03e44-0430-45c6-a1f0-203fdc0df355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:16.850102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a5e03e44-0430-45c6-a1f0-203fdc0df355 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:16.851306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a5e03e44-0430-45c6-a1f0-203fdc0df355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:16.948749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 737/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:17.032093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f85d-6c56-4986-8eae-9ac89fbd1360 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:17.032359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f85d-6c56-4986-8eae-9ac89fbd1360 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:17.032644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f85d-6c56-4986-8eae-9ac89fbd1360 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:17.034030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 736/1473] 10.222.0.60 () {54 vars in 966 bytes} [Wed Jul 27 08:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:17.038908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd8e2d-13a5-481e-bf99-47a276ae9c3c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:17.039199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd8e2d-13a5-481e-bf99-47a276ae9c3c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:17.039475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd8e2d-13a5-481e-bf99-47a276ae9c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:17.115088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-21fd8e2d-13a5-481e-bf99-47a276ae9c3c None None] MFA Rules not processed for user `1f9429e0cfd94f279a255fff511a4737`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:17.116288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-21fd8e2d-13a5-481e-bf99-47a276ae9c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:17.137027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:17.191715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 738/1474] 10.222.0.60 () {58 vars in 1063 bytes} [Wed Jul 27 08:33:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:17.200057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f85d-6c56-4986-8eae-9ac89fbd1360 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:17.201707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ffb6f85d-6c56-4986-8eae-9ac89fbd1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:17.308446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f85d-6c56-4986-8eae-9ac89fbd1360 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:17.382567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:17.383229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:17.383513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:17.383794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:17.385473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:17.439464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:17.494365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:17.496596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8c1a0-52c8-4de5-a40a-6a4103ed6bd0 service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:17.516125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 737/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:19.616910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5bf0-ec96-4585-9b88-b8108248e8da None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:19.617501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5bf0-ec96-4585-9b88-b8108248e8da None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:19.617501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5bf0-ec96-4585-9b88-b8108248e8da None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:19.618811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 739/1476] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:19.624920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b082af-0764-4f26-a3b1-e5fbdd857866 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:19.625347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b082af-0764-4f26-a3b1-e5fbdd857866 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:19.625513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b082af-0764-4f26-a3b1-e5fbdd857866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:19.690904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b3b082af-0764-4f26-a3b1-e5fbdd857866 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:19.692121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b3b082af-0764-4f26-a3b1-e5fbdd857866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:19.787530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 738/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:19.811518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5bf0-ec96-4585-9b88-b8108248e8da None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:19.813072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5b1c5bf0-ec96-4585-9b88-b8108248e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:19.936462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5bf0-ec96-4585-9b88-b8108248e8da None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:19.984012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:20.027670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:20.028293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:20.028573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:20.028880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:20.029572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:20.031299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:33:20.031299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:33:20.031299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:33:20.032432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfaa95-adad-4f55-83f4-bfb59daf5496 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:20.051353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 740/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Jul 27 08:33:19 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:33:22.058697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bbff-e056-405e-88a4-2a55d6967fdd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:22.059257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bbff-e056-405e-88a4-2a55d6967fdd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:22.059257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bbff-e056-405e-88a4-2a55d6967fdd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:22.060644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 739/1479] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:22.065704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a523e-8442-47f7-b75e-a6f1b5ebf236 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:22.066171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a523e-8442-47f7-b75e-a6f1b5ebf236 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:22.066280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a523e-8442-47f7-b75e-a6f1b5ebf236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:22.133195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b20a523e-8442-47f7-b75e-a6f1b5ebf236 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:22.134406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b20a523e-8442-47f7-b75e-a6f1b5ebf236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:22.229872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 741/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:22.273096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024bbff-e056-405e-88a4-2a55d6967fdd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:22.274710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9024bbff-e056-405e-88a4-2a55d6967fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:22.284977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:22.420670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024bbff-e056-405e-88a4-2a55d6967fdd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:22.498213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:22.532185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:22.532834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:22.533120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:22.533398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:22.535013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:22.623746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:22.625395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327a48-2199-4998-a69a-61fcfe95e1c9 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:22.643491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 740/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:24.815497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae779b-19d3-4cca-a483-b7b63b2337a6 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:24.816028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae779b-19d3-4cca-a483-b7b63b2337a6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:24.816028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae779b-19d3-4cca-a483-b7b63b2337a6 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:24.817365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 742/1482] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:24.822656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429156c4-ccb3-442d-ab0a-7df89b5e89bb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:24.823085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429156c4-ccb3-442d-ab0a-7df89b5e89bb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:24.823278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429156c4-ccb3-442d-ab0a-7df89b5e89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:24.889202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-429156c4-ccb3-442d-ab0a-7df89b5e89bb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:24.891376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-429156c4-ccb3-442d-ab0a-7df89b5e89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:24.937537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:24.988326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 741/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:25.025781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae779b-19d3-4cca-a483-b7b63b2337a6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:25.027522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4fae779b-19d3-4cca-a483-b7b63b2337a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:25.050428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:25.129969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae779b-19d3-4cca-a483-b7b63b2337a6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:25.204058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:25.204688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:25.205011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:25.205280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:25.206926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:25.281687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:25.316296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:25.317882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdf2a7-f656-42d7-9e5c-342f2ae0b704 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:25.336976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 743/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:27.412461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fa1e-7183-451c-af45-9ea92656e802 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:27.412985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fa1e-7183-451c-af45-9ea92656e802 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:27.413083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fa1e-7183-451c-af45-9ea92656e802 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:27.414418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 742/1485] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:27.419896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4fe0-f375-4466-b1c5-bb6b754772e4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:27.420328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4fe0-f375-4466-b1c5-bb6b754772e4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:27.420438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd4fe0-f375-4466-b1c5-bb6b754772e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:27.485328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fbfd4fe0-f375-4466-b1c5-bb6b754772e4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:27.486527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbfd4fe0-f375-4466-b1c5-bb6b754772e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:27.584890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 744/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:27.623542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fa1e-7183-451c-af45-9ea92656e802 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:27.625157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-39d0fa1e-7183-451c-af45-9ea92656e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:27.727116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fa1e-7183-451c-af45-9ea92656e802 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:27.800777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:27.802517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:27.803132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:27.803416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:27.803696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:27.805342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:27.914017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:27.915451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584559a8-da93-47c9-a11a-655f4b80e7de service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:27.934242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 743/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:30.097481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4859-2042-4fe6-8ef9-b4262b551448 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:30.098027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4859-2042-4fe6-8ef9-b4262b551448 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:30.098027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4859-2042-4fe6-8ef9-b4262b551448 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:30.099352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 745/1488] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:30.105026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de276d-a078-494c-8678-aa449c3377b0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:30.105496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de276d-a078-494c-8678-aa449c3377b0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:30.105594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de276d-a078-494c-8678-aa449c3377b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:30.171841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-47de276d-a078-494c-8678-aa449c3377b0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:30.173128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-47de276d-a078-494c-8678-aa449c3377b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:30.226465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:30.271154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 744/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:30.314833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4859-2042-4fe6-8ef9-b4262b551448 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:30.316334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e5ae4859-2042-4fe6-8ef9-b4262b551448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:30.353014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:30.421895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4859-2042-4fe6-8ef9-b4262b551448 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:30.497418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:30.498078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:30.498363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:30.498637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:30.500384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:30.583922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:30.613135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:30.614598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9fb63-8833-4a9c-bbd9-55730135e1af service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:30.632953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 746/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:33.044504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f14817-69f1-4382-a6d3-5527734b7fdb None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:33.045104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f14817-69f1-4382-a6d3-5527734b7fdb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:33.045104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f14817-69f1-4382-a6d3-5527734b7fdb None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:33.046472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 745/1491] 10.222.0.60 () {54 vars in 926 bytes} [Wed Jul 27 08:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:33:33.051670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d16be-93a7-48c5-b98f-5b1c8c6bb3b0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:33.052100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d16be-93a7-48c5-b98f-5b1c8c6bb3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:33.052218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d16be-93a7-48c5-b98f-5b1c8c6bb3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:33.117236 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a38d16be-93a7-48c5-b98f-5b1c8c6bb3b0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:33:33.118428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a38d16be-93a7-48c5-b98f-5b1c8c6bb3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:33.219325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 747/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Jul 27 08:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:33:33.258890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f14817-69f1-4382-a6d3-5527734b7fdb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:33:33.260424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-84f14817-69f1-4382-a6d3-5527734b7fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:33.361148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f14817-69f1-4382-a6d3-5527734b7fdb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:33:33.433533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:33:33.434168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:33:33.434461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:33:33.434740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:33:33.436359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:33:33.445423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:33.545152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:33:33.546587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ac4f-0c7e-456c-9625-596f971152b3 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:33:33.564757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 746/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:33:43.217326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=82 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:43.562465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=50 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:35:29.007618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.008237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.008237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.108193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:35:29.109507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:29.220182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 748/1494] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:35:29.228873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.229420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.229420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.265201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:35:29.265201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:29.277516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 747/1495] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:35:29.282258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:29.292629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91adb5-e9a5-4d48-8dc5-6602b028f06c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:29.298447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:29.299171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.299454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.299729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.300634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:35:29.300971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:29.305965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:29.305965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:35:29.305965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:35:29.305965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:29.315634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 749/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:35:29.324369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:29.333786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675ffc8-a683-43fd-924c-285a0edaa5a5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:29.338867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:29.339489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.339771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.340078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.340739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:29.342479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:29.342479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:35:29.342479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:35:29.343676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:29.454567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 748/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:35:29 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:35:29.459459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:29.471134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91ff63-75ed-40a5-9226-2d0a09929f00 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:29.532540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:35:29.540384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:29.541057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.541345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.541685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.542378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:29.543403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:29.543403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:35:29.543403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:35:29.544812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:29.629738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 750/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:35:29 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:35:29.634416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:29.645329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2d53-c658-4cc1-80a7-51584cfdacb4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:29.650453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:35:29.658803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:35:29.659382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:29.667640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 749/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:35:29.671714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:29.682139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904afc2e-d021-40f9-a398-55c56cf47395 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:29.686782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:29.687412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.687697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.687973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.688665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:29.689705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:29.689705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:35:29.689705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:35:29.690591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e465dc7-a272-4b59-a22e-2e3d55f145c9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:29.704345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 751/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:35:29.708566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:29.719561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b432-fbfa-40f1-a91a-d4cf1025a467 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:29.724243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:29.724944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.725264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.725546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] PATH_INFO: `/v3/projects/81443199a33e497382d93a99da58cc74/users/2a2659da69d842ebaa352a0b21e18369/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.740974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=81443199a33e497382d93a99da58cc74, user_id=2a2659da69d842ebaa352a0b21e18369, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:29.741995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:29.741995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:35:29.741995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:35:29.744002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8080c-9951-4b72-a422-e7a164e41fff admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:29.810908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 750/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:35:29 2022] PUT /identity/v3/projects/81443199a33e497382d93a99da58cc74/users/2a2659da69d842ebaa352a0b21e18369/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:35:29.824029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b41a-0832-40e6-b4eb-8cae699fd165 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.824927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b41a-0832-40e6-b4eb-8cae699fd165 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.824927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b41a-0832-40e6-b4eb-8cae699fd165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.853363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3a65b41a-0832-40e6-b4eb-8cae699fd165 None None] MFA Rules not processed for user `2a2659da69d842ebaa352a0b21e18369`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:35:29.854566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3a65b41a-0832-40e6-b4eb-8cae699fd165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:29.921691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 752/1502] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:35:29.934789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce8c5-6847-45bb-98aa-44c324a85304 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.935085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce8c5-6847-45bb-98aa-44c324a85304 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.935375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce8c5-6847-45bb-98aa-44c324a85304 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:29.936771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 751/1503] 10.222.0.60 () {54 vars in 964 bytes} [Wed Jul 27 08:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:35:29.941550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fa9c-e5cd-42ac-bf8d-d95713c67d62 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:29.941884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fa9c-e5cd-42ac-bf8d-d95713c67d62 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:29.942157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fa9c-e5cd-42ac-bf8d-d95713c67d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:30.000692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cbe4fa9c-e5cd-42ac-bf8d-d95713c67d62 None None] MFA Rules not processed for user `9f29724574eb4370a0f60e2a612401cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:35:30.001936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cbe4fa9c-e5cd-42ac-bf8d-d95713c67d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:30.076529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 753/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Jul 27 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:35:30.084315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce8c5-6847-45bb-98aa-44c324a85304 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:30.095278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce8c5-6847-45bb-98aa-44c324a85304 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:30.098802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:30.099404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:30.099687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:30.099963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:30.108063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:30.109523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:30.118834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 752/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:35:30.163506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeddbe-0445-4cf9-9acb-05aa4cc3444a None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:30.163797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeddbe-0445-4cf9-9acb-05aa4cc3444a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:30.164076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeddbe-0445-4cf9-9acb-05aa4cc3444a None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:30.165384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 754/1506] 10.222.0.60 () {52 vars in 830 bytes} [Wed Jul 27 08:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:35:30.168911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:30.229609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161d2f-6390-459a-b2da-6a0b2e2aa264 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:30.234259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:30.234893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:30.235180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:30.235458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] PATH_INFO: `/v3/users/2a2659da69d842ebaa352a0b21e18369` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:30.236623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2659da69d842ebaa352a0b21e18369)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:30.237676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:30.237676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:35:30.237676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:35:30.238894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:30.485320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2659da69d842ebaa352a0b21e18369'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:30.486048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2659da69d842ebaa352a0b21e18369'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:30.499037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2659da69d842ebaa352a0b21e18369'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:30.517436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2659da69d842ebaa352a0b21e18369'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:30.518170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2659da69d842ebaa352a0b21e18369'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:30.522275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:35:30.618405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 753/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:35:30 2022] DELETE /identity/v3/users/2a2659da69d842ebaa352a0b21e18369 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:35:30.623271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:30.623562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:30.623841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:30.642961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:35:30.644159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:30.653437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:35:30.703671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 755/1508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:35:30.713320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:30.714734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:30.792678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76643cae-e68e-4c61-8a35-08f209bde741 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:30.796295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88559535-4ac5-451d-9081-d04e3b5d2379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:30.796946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559535-4ac5-451d-9081-d04e3b5d2379 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:30.797243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559535-4ac5-451d-9081-d04e3b5d2379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:30.797513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559535-4ac5-451d-9081-d04e3b5d2379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:30.807302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88559535-4ac5-451d-9081-d04e3b5d2379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:30.808748 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88559535-4ac5-451d-9081-d04e3b5d2379 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:30.818158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 754/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:35:31.283877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:35:31.285736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:35:31.299266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dcebe-48ea-4e6b-a5e8-404283d64990 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:35:31.305480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:35:31.309226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:35:31.309226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:35:31.309226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] PATH_INFO: `/v3/projects/81443199a33e497382d93a99da58cc74` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:35:31.309740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81443199a33e497382d93a99da58cc74)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:35:31.310785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:35:31.310785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:35:31.310785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:35:31.312783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:35:31.458049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81443199a33e497382d93a99da58cc74', 'request_id': 'req-c539797c-d9e6-44e3-9676-6ae16a098404'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:31.472378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81443199a33e497382d93a99da58cc74', 'request_id': 'req-c539797c-d9e6-44e3-9676-6ae16a098404'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:31.478540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81443199a33e497382d93a99da58cc74', 'request_id': 'req-c539797c-d9e6-44e3-9676-6ae16a098404'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:31.553386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] The token cache is being invalidate because project 81443199a33e497382d93a99da58cc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:35:31.553635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:31.554356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c539797c-d9e6-44e3-9676-6ae16a098404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:35:31.555907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 756/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:35:31 2022] DELETE /identity/v3/projects/81443199a33e497382d93a99da58cc74 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:35:40.814197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:35:41.549844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:21.654074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff6df5-5417-4106-b534-0f7108aebb67 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:21.654611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff6df5-5417-4106-b534-0f7108aebb67 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:21.654717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff6df5-5417-4106-b534-0f7108aebb67 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:21.656058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:21.661048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6254f7b-5d4c-404c-8b27-20456e9c5cf1 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:21.661475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6254f7b-5d4c-404c-8b27-20456e9c5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:21.662363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6254f7b-5d4c-404c-8b27-20456e9c5cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:21.681816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c6254f7b-5d4c-404c-8b27-20456e9c5cf1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:21.683044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c6254f7b-5d4c-404c-8b27-20456e9c5cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:21.741607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:21.896381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff6df5-5417-4106-b534-0f7108aebb67 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:21.900911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-45ff6df5-5417-4106-b534-0f7108aebb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:22.003352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff6df5-5417-4106-b534-0f7108aebb67 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:22.009097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0365-00e0-4418-a5d5-af7251349e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:22.009714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0365-00e0-4418-a5d5-af7251349e0b service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:22.010000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0365-00e0-4418-a5d5-af7251349e0b service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:22.010278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0365-00e0-4418-a5d5-af7251349e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:22.018866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0365-00e0-4418-a5d5-af7251349e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:22.020535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0365-00e0-4418-a5d5-af7251349e0b service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:22.030193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 756/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:22.865576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff00710-d3c7-483f-b491-252375c50d70 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:22.866120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff00710-d3c7-483f-b491-252375c50d70 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:22.866120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff00710-d3c7-483f-b491-252375c50d70 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:22.867400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:22.872108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa5fcf-d5b0-47cc-8cef-e860b82ee50e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:22.872526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa5fcf-d5b0-47cc-8cef-e860b82ee50e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:22.872669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa5fcf-d5b0-47cc-8cef-e860b82ee50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:22.892459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c4fa5fcf-d5b0-47cc-8cef-e860b82ee50e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:22.893694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c4fa5fcf-d5b0-47cc-8cef-e860b82ee50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:22.902263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:23.056587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff00710-d3c7-483f-b491-252375c50d70 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:23.070823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff00710-d3c7-483f-b491-252375c50d70 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:23.076269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46743ed5-3cd8-43d6-8479-7875304fcc99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:23.084583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46743ed5-3cd8-43d6-8479-7875304fcc99 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:23.084583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46743ed5-3cd8-43d6-8479-7875304fcc99 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:23.084583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46743ed5-3cd8-43d6-8479-7875304fcc99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:23.086242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46743ed5-3cd8-43d6-8479-7875304fcc99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:23.087841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46743ed5-3cd8-43d6-8479-7875304fcc99 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:23.097686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 759/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:23.803778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6d71-e05a-49af-a906-6b286d5c407b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:23.804021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6d71-e05a-49af-a906-6b286d5c407b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:23.804248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6d71-e05a-49af-a906-6b286d5c407b None None] PATH_INFO: `/v3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:23.805570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 758/1517] 10.222.0.36 () {54 vars in 925 bytes} [Wed Jul 27 08:37:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:37:23.812133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221d28-c3ad-44b8-920f-f3596e5ddb55 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:23.812426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221d28-c3ad-44b8-920f-f3596e5ddb55 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:23.812696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221d28-c3ad-44b8-920f-f3596e5ddb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:23.862142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ec221d28-c3ad-44b8-920f-f3596e5ddb55 None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:23.863337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ec221d28-c3ad-44b8-920f-f3596e5ddb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:23.935166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 760/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jul 27 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:27.973621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2138c6-6e62-44c3-9f46-44075528f07f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:27.974217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2138c6-6e62-44c3-9f46-44075528f07f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:27.974217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2138c6-6e62-44c3-9f46-44075528f07f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:27.975538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 759/1519] 10.222.0.60 () {54 vars in 961 bytes} [Wed Jul 27 08:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:27.980480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b583-2df8-415f-9ca5-fd5a3f4ea9ea None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:27.980897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b583-2df8-415f-9ca5-fd5a3f4ea9ea None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:27.981061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b583-2df8-415f-9ca5-fd5a3f4ea9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:28.000481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0343b583-2df8-415f-9ca5-fd5a3f4ea9ea None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:28.001684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0343b583-2df8-415f-9ca5-fd5a3f4ea9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:28.010764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 761/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Jul 27 08:37:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:28.018387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2138c6-6e62-44c3-9f46-44075528f07f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:28.032287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2138c6-6e62-44c3-9f46-44075528f07f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:28.037417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515fbdc-de34-4445-999b-e83569f64001 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:28.038018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515fbdc-de34-4445-999b-e83569f64001 service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:28.038306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515fbdc-de34-4445-999b-e83569f64001 service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:28.038588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515fbdc-de34-4445-999b-e83569f64001 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:28.046913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515fbdc-de34-4445-999b-e83569f64001 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:28.048548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515fbdc-de34-4445-999b-e83569f64001 service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:28.058302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 760/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:34.365299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c50d-20fb-4a84-812f-ea10298deeae None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:34.366446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c50d-20fb-4a84-812f-ea10298deeae None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:34.366446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c50d-20fb-4a84-812f-ea10298deeae None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:34.367796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:34.372511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb39ec-f8fa-4562-81fe-29954537f49f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:34.372950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb39ec-f8fa-4562-81fe-29954537f49f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:34.373109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb39ec-f8fa-4562-81fe-29954537f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:34.393258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-94fb39ec-f8fa-4562-81fe-29954537f49f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:34.394465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-94fb39ec-f8fa-4562-81fe-29954537f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:34.402488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:34.558460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c50d-20fb-4a84-812f-ea10298deeae None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:34.572996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c50d-20fb-4a84-812f-ea10298deeae None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:34.578448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4808a5e-c7b5-45a8-9ff0-11d02645c6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:34.579049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808a5e-c7b5-45a8-9ff0-11d02645c6c3 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:34.579338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808a5e-c7b5-45a8-9ff0-11d02645c6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:34.579615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808a5e-c7b5-45a8-9ff0-11d02645c6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:34.587969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808a5e-c7b5-45a8-9ff0-11d02645c6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:34.589590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808a5e-c7b5-45a8-9ff0-11d02645c6c3 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:34.599084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 763/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:35.414561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56495613-8d18-4787-9fcc-edf1e8abbb27 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:35.415093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56495613-8d18-4787-9fcc-edf1e8abbb27 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:35.415185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56495613-8d18-4787-9fcc-edf1e8abbb27 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:35.416482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:35.421452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded38f-be42-492a-9d8c-17dc0cb6f1ca None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:35.421891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded38f-be42-492a-9d8c-17dc0cb6f1ca None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:35.421989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded38f-be42-492a-9d8c-17dc0cb6f1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:35.440835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d9ded38f-be42-492a-9d8c-17dc0cb6f1ca None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:35.442010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d9ded38f-be42-492a-9d8c-17dc0cb6f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:35.450521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:35.605679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56495613-8d18-4787-9fcc-edf1e8abbb27 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:35.620515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56495613-8d18-4787-9fcc-edf1e8abbb27 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:35.625946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ecdfe-0c11-41cb-ba47-d17a8b714a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:35.626559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecdfe-0c11-41cb-ba47-d17a8b714a30 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:35.626842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecdfe-0c11-41cb-ba47-d17a8b714a30 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:35.627117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecdfe-0c11-41cb-ba47-d17a8b714a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:35.635853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ecdfe-0c11-41cb-ba47-d17a8b714a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:35.637470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ecdfe-0c11-41cb-ba47-d17a8b714a30 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:35.646770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 763/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:40.175842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba735a-a4ec-422f-94e1-2eb615800631 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:40.176413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba735a-a4ec-422f-94e1-2eb615800631 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:40.176413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba735a-a4ec-422f-94e1-2eb615800631 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:40.177772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:40.183572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774500-3ffc-4a8d-bc1d-e09960c3d993 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:40.183998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774500-3ffc-4a8d-bc1d-e09960c3d993 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:40.184104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774500-3ffc-4a8d-bc1d-e09960c3d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:40.203636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9b774500-3ffc-4a8d-bc1d-e09960c3d993 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:40.204847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9b774500-3ffc-4a8d-bc1d-e09960c3d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:40.212696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:37:40.285318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba735a-a4ec-422f-94e1-2eb615800631 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:40.287038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5dba735a-a4ec-422f-94e1-2eb615800631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:40.316493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:40.346268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba735a-a4ec-422f-94e1-2eb615800631 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:40.350464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22606ab5-a860-49a9-93a2-09e361f1e642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:40.351085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22606ab5-a860-49a9-93a2-09e361f1e642 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:40.351365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22606ab5-a860-49a9-93a2-09e361f1e642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:40.351641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22606ab5-a860-49a9-93a2-09e361f1e642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:40.360918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22606ab5-a860-49a9-93a2-09e361f1e642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:40.362354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22606ab5-a860-49a9-93a2-09e361f1e642 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:40.371832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 766/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:42.368208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555de1-8a97-4560-bcf1-a26ab33c17ea None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:42.368848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555de1-8a97-4560-bcf1-a26ab33c17ea None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:42.368848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555de1-8a97-4560-bcf1-a26ab33c17ea None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:42.370137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:42.375254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3ef2-a552-456e-9262-3f1b83c2a926 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:42.375715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3ef2-a552-456e-9262-3f1b83c2a926 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:42.375821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3ef2-a552-456e-9262-3f1b83c2a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:42.395833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b6dc3ef2-a552-456e-9262-3f1b83c2a926 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:42.397216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b6dc3ef2-a552-456e-9262-3f1b83c2a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:42.404990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:42.440573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555de1-8a97-4560-bcf1-a26ab33c17ea None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:42.451881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555de1-8a97-4560-bcf1-a26ab33c17ea None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:42.455378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeda0df-18f6-4164-a376-365478b0886a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:42.455983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeda0df-18f6-4164-a376-365478b0886a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:42.456268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeda0df-18f6-4164-a376-365478b0886a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:42.456548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeda0df-18f6-4164-a376-365478b0886a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:42.465504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeda0df-18f6-4164-a376-365478b0886a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:42.466931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeda0df-18f6-4164-a376-365478b0886a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:42.476320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 766/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:46.073417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065d67a-16f5-47f0-856d-d3794f0b60ea None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:46.073977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065d67a-16f5-47f0-856d-d3794f0b60ea None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:46.073977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065d67a-16f5-47f0-856d-d3794f0b60ea None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:46.075368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:46.080694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f997-d140-4809-a04d-8b4d5af7dc21 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:46.081132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f997-d140-4809-a04d-8b4d5af7dc21 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:46.081297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f997-d140-4809-a04d-8b4d5af7dc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:46.101141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-72c4f997-d140-4809-a04d-8b4d5af7dc21 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:46.102344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-72c4f997-d140-4809-a04d-8b4d5af7dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:46.110425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:37:46.419136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065d67a-16f5-47f0-856d-d3794f0b60ea None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:46.420848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d065d67a-16f5-47f0-856d-d3794f0b60ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:46.476953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065d67a-16f5-47f0-856d-d3794f0b60ea None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:46.480446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb880-5f4d-4895-a043-348e455db286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:46.481084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb880-5f4d-4895-a043-348e455db286 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:46.481364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb880-5f4d-4895-a043-348e455db286 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:46.481636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb880-5f4d-4895-a043-348e455db286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:46.490813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb880-5f4d-4895-a043-348e455db286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:46.492242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb880-5f4d-4895-a043-348e455db286 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:46.501635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 769/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:48.550998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538fd9-fa7e-4a6b-85b1-613167d3bf3e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:48.551513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538fd9-fa7e-4a6b-85b1-613167d3bf3e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:48.551611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538fd9-fa7e-4a6b-85b1-613167d3bf3e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:48.553466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:37:48.558567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f939558-e091-4dfe-85da-eb3aaa80e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:48.559009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f939558-e091-4dfe-85da-eb3aaa80e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:48.559147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f939558-e091-4dfe-85da-eb3aaa80e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:48.578854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6f939558-e091-4dfe-85da-eb3aaa80e2e1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:37:48.580045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6f939558-e091-4dfe-85da-eb3aaa80e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:48.588165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:37:48.893423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc538fd9-fa7e-4a6b-85b1-613167d3bf3e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:37:48.895078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dc538fd9-fa7e-4a6b-85b1-613167d3bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:37:48.907993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc538fd9-fa7e-4a6b-85b1-613167d3bf3e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:37:48.911457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05efd8-fb9d-4d13-ac23-420775a333f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:37:48.912553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05efd8-fb9d-4d13-ac23-420775a333f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:37:48.912939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05efd8-fb9d-4d13-ac23-420775a333f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:37:48.913229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05efd8-fb9d-4d13-ac23-420775a333f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:37:48.922025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05efd8-fb9d-4d13-ac23-420775a333f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:37:48.923421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05efd8-fb9d-4d13-ac23-420775a333f4 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:37:48.933381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 769/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:37:58.573586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=47 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:58.929361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=82 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:26.140521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a8af-fc64-498c-ab7f-34d1133cc447 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.141204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a8af-fc64-498c-ab7f-34d1133cc447 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.141363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a8af-fc64-498c-ab7f-34d1133cc447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.169646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-be08a8af-fc64-498c-ab7f-34d1133cc447 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.170075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825be79-8dab-4ef9-a2d3-ae5d5ba998d4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.170582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825be79-8dab-4ef9-a2d3-ae5d5ba998d4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.170692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825be79-8dab-4ef9-a2d3-ae5d5ba998d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.170879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-be08a8af-fc64-498c-ab7f-34d1133cc447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.186835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 771/1540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.199404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7825be79-8dab-4ef9-a2d3-ae5d5ba998d4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.200654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7825be79-8dab-4ef9-a2d3-ae5d5ba998d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.213413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4d62-a9a8-4093-ac66-0b0ad37b502e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.213746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4d62-a9a8-4093-ac66-0b0ad37b502e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.214003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4d62-a9a8-4093-ac66-0b0ad37b502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.218497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 770/1541] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.238686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.239032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.239252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.247770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fa7a4d62-a9a8-4093-ac66-0b0ad37b502e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.253557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fa7a4d62-a9a8-4093-ac66-0b0ad37b502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.270056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 772/1542] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 27 08:39:26.274039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.274330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.274604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.277960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.279426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.298411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 771/1543] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:39:26.300899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.319496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.321143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.322087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8ed37-0065-44b0-98fc-d23249cf3a9c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.332972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.333613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.333898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.334175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.334878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:26.335186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.335879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 773/1544] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.336333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:39:26.336333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:39:26.336333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:39:26.336610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.337397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eda6f-6cee-465b-a183-a7954ea58c35 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.357037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852213c-3265-477b-974e-068d93ca4a5b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.363931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 772/1545] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:26.365173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.365568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.365938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.368632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.369428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.369893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.370175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.370904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:26.371181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.372820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.399964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 774/1546] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:26.401145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.404665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.406009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.420932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 773/1547] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.421833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.422053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2cd1-4a17-4814-9bbf-0945fbc4e0f8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.434600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cf734-d25a-4da9-a4e9-818b6cb3bd41 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.440552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.441229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.441511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.441783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.442457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.443481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:39:26.443481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:39:26.443481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:39:26.446658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.451492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b2e2d-cba9-4afc-b98e-359088c6eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.452124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2e2d-cba9-4afc-b98e-359088c6eb9e admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.452407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2e2d-cba9-4afc-b98e-359088c6eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.452682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2e2d-cba9-4afc-b98e-359088c6eb9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.453380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2e2d-cba9-4afc-b98e-359088c6eb9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.456103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2e2d-cba9-4afc-b98e-359088c6eb9e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.578506 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 775/1548] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:26.579333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.606826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 774/1549] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:26.608708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c00f-0f13-4b7b-a85b-908916ba9e2f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.609473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c00f-0f13-4b7b-a85b-908916ba9e2f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.609861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c00f-0f13-4b7b-a85b-908916ba9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.631230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-90f9c00f-0f13-4b7b-a85b-908916ba9e2f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.632442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-90f9c00f-0f13-4b7b-a85b-908916ba9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.648136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36926838-8663-4ee9-8d11-65645a752aae admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.698753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 775/1550] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.700114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebae78-18b9-4c5d-9d61-120235d32bcd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.700409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebae78-18b9-4c5d-9d61-120235d32bcd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.700690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebae78-18b9-4c5d-9d61-120235d32bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.717034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.717674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.717956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.718231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.719062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:26.719381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.721080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7943e4-4ebf-4d82-83cb-5eb137002a8c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.721911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ccebae78-18b9-4c5d-9d61-120235d32bcd None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.723156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ccebae78-18b9-4c5d-9d61-120235d32bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.732439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 776/1551] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.740043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 776/1552] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:26.740242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.740242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.740420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.740520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.740617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.740617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.758097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.759340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.759777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.761001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.768832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 777/1553] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.772780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.772963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 777/1554] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.772963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.786038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8e6d-1c50-4e04-bae8-404a46771125 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.788005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dd708-e1cb-4d20-9fda-8da4ea071a98 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.790883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.791524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.791805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.792136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.792651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f751c4-41fb-4a35-a64f-a7812a3c6926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.792868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.793311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f751c4-41fb-4a35-a64f-a7812a3c6926 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.793584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f751c4-41fb-4a35-a64f-a7812a3c6926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.793860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f751c4-41fb-4a35-a64f-a7812a3c6926 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.793966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:39:26.793966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:39:26.793966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:39:26.794523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f751c4-41fb-4a35-a64f-a7812a3c6926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.795086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef50c7b-09f9-44a3-960a-19ee24d70a02 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.796442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f751c4-41fb-4a35-a64f-a7812a3c6926 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.883365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 778/1555] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:26.884859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4228f4-0b0b-4e23-829b-0ffec5a5a69d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.885188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4228f4-0b0b-4e23-829b-0ffec5a5a69d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.885612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4228f4-0b0b-4e23-829b-0ffec5a5a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.907635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8a4228f4-0b0b-4e23-829b-0ffec5a5a69d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.907635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8a4228f4-0b0b-4e23-829b-0ffec5a5a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.915806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 779/1556] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.917164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.917449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.917728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.932297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 778/1557] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:26.933581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446d54-6723-4819-bdf1-8055e1178de9 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.933867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446d54-6723-4819-bdf1-8055e1178de9 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.934141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446d54-6723-4819-bdf1-8055e1178de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.937321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.938615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.947145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 780/1558] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.947926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:26.957077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0e446d54-6723-4819-bdf1-8055e1178de9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.958111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006a3c-fedd-4a73-885d-0ae8220f8eed None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:26.958244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0e446d54-6723-4819-bdf1-8055e1178de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:26.962913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d75237-36a4-4db5-b8d1-53286940d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:26.965030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75237-36a4-4db5-b8d1-53286940d8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.965030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75237-36a4-4db5-b8d1-53286940d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.965030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75237-36a4-4db5-b8d1-53286940d8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.965030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75237-36a4-4db5-b8d1-53286940d8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:26.966132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 779/1559] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:26.966663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75237-36a4-4db5-b8d1-53286940d8bd admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:26.970636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533c4f-d9c1-433e-9c6c-02d7f0fb1743 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:26.970964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533c4f-d9c1-433e-9c6c-02d7f0fb1743 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:26.971422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533c4f-d9c1-433e-9c6c-02d7f0fb1743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:26.991618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a2533c4f-d9c1-433e-9c6c-02d7f0fb1743 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:26.993769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a2533c4f-d9c1-433e-9c6c-02d7f0fb1743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:27.000490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 780/1560] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:27.001745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.002037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.002838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.020976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:27.022447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:27.030332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 781/1561] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:27.031113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.035570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:27.040614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928da9-3de7-4091-a3e6-38ce9401f33d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.045227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.045795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.046072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.046336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.047005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.048116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 781/1562] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:26 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.048818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.051160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.051160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.051160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.064308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 782/1563] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:27.064308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.071273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:27.072582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:27.075486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c42cb-a7c8-4e7f-b56a-b8d959512a98 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.105891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:27.131711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.132333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.132616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.132925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.133355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 782/1564] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:27.133695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.134557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.135314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.144534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbf5a6-d1d4-4eec-9aec-44f972beb5aa None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.149498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 783/1565] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:27.149498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.150111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.150111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.150413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.150705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.151386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:27.151691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.153327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.157252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac206-fae7-41bc-8589-5213e5ae423a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.162035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.162572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.162857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.163145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.163830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:27.164134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.165764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.173173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 783/1566] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:27.173173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.177005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1aa9e-29d1-45db-b6a4-c03359090ad0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.181829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.182449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.182742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.183025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.183715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:27.184052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.185668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.185980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 784/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:27.186812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.198294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdc387-8be6-436e-b0fe-2326e01ede69 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.200810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 784/1568] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:27.201608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.208540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.209182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.209460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.209729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.210409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:27.210731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.212332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.216215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5fc1-9ccb-4470-b009-6867a9df9396 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.222093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.222863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.223146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.223425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.223723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 785/1569] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:27.224082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.224539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.226034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.236043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b146-6529-4c25-945e-f10564ea6a5f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.241497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.242135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.242417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.242692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.243382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.244998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.256142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 786/1570] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:27.256958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.266243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baada72-4589-4d97-8404-05c8bc8db56a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.271397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.271964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.272243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.272511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.273233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:27.273535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.275074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.286892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 787/1571] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:27.287648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.297140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba49eb-ca2a-43f9-9eb3-e9160e2ff576 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.301900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.302496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.302776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.303051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.303732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.305426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 785/1572] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.305426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.313783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.320385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 788/1573] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:27.320532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f443-a8c3-4c2f-8efb-bfe64d67d629 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.320634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.325136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.326521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.326783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.327060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.327738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.329903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.333183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22646b8-171c-491b-8934-88131b5c05be admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.338476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.339097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.339380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.339651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.340519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.342508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.422542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 786/1574] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.422542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.482610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 789/1575] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.482610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.484620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068c5fe-2eb5-4a97-9acb-51a2c79e94d6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.545823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2f420-143a-4a70-961c-36d465592b01 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.548828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.549935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.550224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.550504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.550990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.551193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.551602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.551880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.552154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.552838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.553142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.554728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.565791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:27.669322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 787/1576] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.669322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.676141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:27.687602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 790/1577] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.687602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.731981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4deaf4-5288-4917-b03b-1eb79b9ee5db admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.748546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f779a3-07eb-40a3-902a-11c26c348a35 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.753282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.753906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.754175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.754444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.755101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.757064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.790953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.791628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.791915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.792194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] PATH_INFO: `/v3/projects/10495cdea53e459288d1949eb788d86b/users/8737247b374f45338fa9370dac461835/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.805813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] RBAC: Authorizing `identity:create_grant(project_id=10495cdea53e459288d1949eb788d86b, user_id=8737247b374f45338fa9370dac461835, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.808560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.856010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 791/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:27.856868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.877628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 788/1579] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:27 2022] PUT /identity/v3/projects/10495cdea53e459288d1949eb788d86b/users/8737247b374f45338fa9370dac461835/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:27.878457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:27.920282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4d868-3f76-4b20-b7d3-17a27f1ef2e1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.942457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fbc1d-8b16-4276-a30d-c68a4566adac admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:27.947041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.947746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.948032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.948314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] PATH_INFO: `/v3/projects/6add677907ea469a8379675104571fd3/users/4d4013ba9eca412b81585544a52e38ea/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.963709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6add677907ea469a8379675104571fd3, user_id=4d4013ba9eca412b81585544a52e38ea, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.966446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.977344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:27.979367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:27.979367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:27.979367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:27.979367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:27.981175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:27.990944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 792/1580] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:27.991703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.000779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3676a49-e813-4e2e-9f08-67c7096585d9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.005592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.006180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.006464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.006736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.007425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.009415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.021437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 789/1581] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:27 2022] PUT /identity/v3/projects/6add677907ea469a8379675104571fd3/users/4d4013ba9eca412b81585544a52e38ea/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:28.022249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.042670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:28.076226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:28.082078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beefce-3e94-47a3-8eed-f8ce140856b7 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.084018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 793/1582] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:27 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:28.084018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.087194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.087893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.088175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.088446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.089132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.091102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.092698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f202dd-49d0-4e91-b229-38ae71ebdf9e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.097701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.098302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.098583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.098860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.099507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.101468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.174884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 794/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:28.175590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 790/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:28.175955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.176270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.186090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cb74-157e-47ea-82e5-a37a551015ae admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.186758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acdc5c-150b-4d37-9dfd-b71d2427980f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.191432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258059-2b71-472d-8e32-4bc0a74bb4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.192045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258059-2b71-472d-8e32-4bc0a74bb4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.192357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258059-2b71-472d-8e32-4bc0a74bb4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.192540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.192714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258059-2b71-472d-8e32-4bc0a74bb4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.193065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.193356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.193465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258059-2b71-472d-8e32-4bc0a74bb4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.193618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.194269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.195315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258059-2b71-472d-8e32-4bc0a74bb4c7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.196183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.270096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 791/1585] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:28.271346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473783c-c812-4315-aa51-c78f64d889c8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.271640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473783c-c812-4315-aa51-c78f64d889c8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.271923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473783c-c812-4315-aa51-c78f64d889c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.294861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 795/1586] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:28.300393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8473783c-c812-4315-aa51-c78f64d889c8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:28.300517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.300634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8473783c-c812-4315-aa51-c78f64d889c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:28.305375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 792/1587] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:28.305741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c627-cf29-44c4-8ff6-d9a240f79cd8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.306901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.307394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.307676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.319089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.319716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.320058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.320332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.321058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.323153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.327607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:28.328868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:28.333996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 796/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.334900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.337470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 793/1589] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:28.338480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.345902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226eb8-f4ac-4fb9-8765-9a42d3e23a6e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.348550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a36f7-29fd-4347-8320-840a0bc5228c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.351021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.351719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.351962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.352238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.352975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.353162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.354098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.354381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.354623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.354736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.355626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.357233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.366730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 797/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.370070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 794/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.370232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.370345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.379867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0129d7c-5060-4528-9604-70836dce3e1b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.380037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c591-1056-4fe5-b80b-175951b4aefc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.384512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.384959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.385599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.385908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.386049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.386204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.386331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.386615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.386891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.387307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.388475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.388947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.399627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 798/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.399779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 795/1593] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.400373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.400479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.414835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527703e-1f3a-4578-9db2-2f4019a237ba admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.419480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.420080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.420364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.420641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.421366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.422951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.432973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 799/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.434081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.444117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30781e-bffb-4d69-ab04-d20addd129b4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.448671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.449344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.449624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.449895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] PATH_INFO: `/v3/projects/e68479247fd14dc98aa1d8c9824800d4/users/0396663dd5344f779feba05636e12ee7/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.463368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc705f0-eb9f-42f2-9d6d-fd41dc8603d6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.464791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68479247fd14dc98aa1d8c9824800d4, user_id=0396663dd5344f779feba05636e12ee7, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.465889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:39:28.465889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:39:28.465889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:39:28.467283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.467898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.468005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.468186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.468464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.477861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.481364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.490038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 796/1595] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:28.490824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.498610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3971-666e-4ae4-9c45-810820bdb27d service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.504218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.504875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.505172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.505451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.515511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.517021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.526749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 797/1596] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:28.527530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.536891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15942490-d1e6-451e-8f47-6cc199367186 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.540183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 800/1597] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:28 2022] PUT /identity/v3/projects/e68479247fd14dc98aa1d8c9824800d4/users/0396663dd5344f779feba05636e12ee7/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:28.541286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.584134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:28.597676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.598307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.598596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.598876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.599573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.601377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.613275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 798/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.616616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.619765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fada0d-efe6-459b-8d27-d34d13a5dcc8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.624655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.624914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d1c3-4f0c-459a-9b69-78393ef45f9d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.625443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.625796 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.626140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.627777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.629669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.630463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.631085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.631377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.631656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.632354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.634123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.641715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 801/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.643062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.651337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 799/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.651337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.657361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971449-87eb-4b4e-a351-84ded3d5153d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.662398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f43f2-d86a-4480-9d36-6e6cedaf8f6b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.663417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363fa01-af88-4a28-a4f3-755f72906227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.664130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363fa01-af88-4a28-a4f3-755f72906227 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.664522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363fa01-af88-4a28-a4f3-755f72906227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.664929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363fa01-af88-4a28-a4f3-755f72906227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.670130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363fa01-af88-4a28-a4f3-755f72906227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.670130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363fa01-af88-4a28-a4f3-755f72906227 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.670351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.670351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.670351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.670351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.670665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.672037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.679686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 802/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.681107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.681467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.681845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.688084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 800/1602] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:28.688084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.704828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c376e7-c700-445b-b8a1-236b30b6dfa2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.704828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.705167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.705494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.705703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] PATH_INFO: `/v3/projects/2079dc00d7c84827ba0c08549ffbdafd/users/fa117823f316456dbec083d3a04d9dc4/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.714824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] MFA Rules not processed for user `0396663dd5344f779feba05636e12ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:28.716196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:28.721621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2079dc00d7c84827ba0c08549ffbdafd, user_id=fa117823f316456dbec083d3a04d9dc4, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.724616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.750453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:28.785475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 803/1603] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:28.786372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.803185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 801/1604] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:28 2022] PUT /identity/v3/projects/2079dc00d7c84827ba0c08549ffbdafd/users/fa117823f316456dbec083d3a04d9dc4/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:28.806795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:28.808139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451a832-a5fc-473d-92ad-faf3ced9d292 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.883983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.884904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.885359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.885797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] PATH_INFO: `/v3/projects/914119bc9357473ebf64d037b8f726b6/users/53c912fe13594cad95d473eb98174f23/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.902696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] RBAC: Authorizing `identity:create_grant(project_id=914119bc9357473ebf64d037b8f726b6, user_id=53c912fe13594cad95d473eb98174f23, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.905216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ffe3-c54e-4624-9bd5-c19aa3ac7dcf admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:28.905614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.912164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:28.912883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:28.913223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:28.913503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] PATH_INFO: `/v3/projects/970510efb0f540d8aefcc6199ea2ce5e/users/a1303857db364b2991017d1a39d8f3ce/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:28.930558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970510efb0f540d8aefcc6199ea2ce5e, user_id=a1303857db364b2991017d1a39d8f3ce, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:28.933277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:28.975829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 804/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:28 2022] PUT /identity/v3/projects/914119bc9357473ebf64d037b8f726b6/users/53c912fe13594cad95d473eb98174f23/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:28.975829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.037478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 802/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:28 2022] PUT /identity/v3/projects/970510efb0f540d8aefcc6199ea2ce5e/users/a1303857db364b2991017d1a39d8f3ce/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:29.037478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.049934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76075e-493b-4e01-b433-f76627d3900b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.106555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66da0-af3e-4efc-8997-78f2fc69a228 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.126637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d486e-d109-403a-8157-1521834aebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.127315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.128313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.128313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.128614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] PATH_INFO: `/v3/projects/53b658685abd4e59ab88c2a2736c6a38/users/f5ab7ab8489b45c3af75187da20695af/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.130215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d486e-d109-403a-8157-1521834aebcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.130762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d486e-d109-403a-8157-1521834aebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.131878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d486e-d109-403a-8157-1521834aebcb admin admin] PATH_INFO: `/v3/projects/3bd839a24c7a4f82903847fe48b83da5/users/63fa285fd1e14d41977a6cd0ceaabb64/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.136366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:29.146086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b658685abd4e59ab88c2a2736c6a38, user_id=f5ab7ab8489b45c3af75187da20695af, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.148567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.154785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d486e-d109-403a-8157-1521834aebcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd839a24c7a4f82903847fe48b83da5, user_id=63fa285fd1e14d41977a6cd0ceaabb64, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.158039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d486e-d109-403a-8157-1521834aebcb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.236048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 803/1607] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:29 2022] PUT /identity/v3/projects/53b658685abd4e59ab88c2a2736c6a38/users/f5ab7ab8489b45c3af75187da20695af/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:29.239843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 805/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:28 2022] PUT /identity/v3/projects/3bd839a24c7a4f82903847fe48b83da5/users/63fa285fd1e14d41977a6cd0ceaabb64/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:29.239843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67226-67de-4045-90c3-586495605fb0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.239843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67226-67de-4045-90c3-586495605fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.239843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67226-67de-4045-90c3-586495605fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.241663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.248032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:29.275140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-04d67226-67de-4045-90c3-586495605fb0 None None] MFA Rules not processed for user `fa117823f316456dbec083d3a04d9dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:29.276448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-04d67226-67de-4045-90c3-586495605fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.308971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae99a53-faa9-4284-aa03-227a2a747522 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.359926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 806/1609] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:29.359926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce362-7b6d-4fad-90f6-1403cc7962cc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.359926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce362-7b6d-4fad-90f6-1403cc7962cc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.359926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce362-7b6d-4fad-90f6-1403cc7962cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.371016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9b7ae-3496-4e40-ab36-0337860b004a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.371921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9b7ae-3496-4e40-ab36-0337860b004a service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.372430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9b7ae-3496-4e40-ab36-0337860b004a service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.372828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9b7ae-3496-4e40-ab36-0337860b004a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.395682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-681ce362-7b6d-4fad-90f6-1403cc7962cc None None] MFA Rules not processed for user `53c912fe13594cad95d473eb98174f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:29.397676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-681ce362-7b6d-4fad-90f6-1403cc7962cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.440220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9b7ae-3496-4e40-ab36-0337860b004a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.441990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9b7ae-3496-4e40-ab36-0337860b004a service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.453771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 804/1610] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:29.456089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1237cb-e2e9-4749-b23c-2f80b1917a49 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.456459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1237cb-e2e9-4749-b23c-2f80b1917a49 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.456901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1237cb-e2e9-4749-b23c-2f80b1917a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.481716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 807/1611] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:29.483492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.483880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.484467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.485600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3d1237cb-e2e9-4749-b23c-2f80b1917a49 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:29.490185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3d1237cb-e2e9-4749-b23c-2f80b1917a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.511264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:29.513466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.592073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 805/1612] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:29.593395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879644-026d-43d3-8b29-90485dbe9c38 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.593711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879644-026d-43d3-8b29-90485dbe9c38 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.594008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879644-026d-43d3-8b29-90485dbe9c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.618747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 808/1613] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:29.618747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.626061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:29.637599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885d1e-3696-4655-b565-cf2723b0b861 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.644397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.645336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.645779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.646201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.647583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.648445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c1879644-026d-43d3-8b29-90485dbe9c38 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:29.649736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c1879644-026d-43d3-8b29-90485dbe9c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.652458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.669835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 806/1614] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:29.671248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad72d-08b2-4d8d-b493-18bf51cf5975 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.671573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad72d-08b2-4d8d-b493-18bf51cf5975 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.671994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad72d-08b2-4d8d-b493-18bf51cf5975 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.673709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 807/1615] 10.222.0.60 () {54 vars in 962 bytes} [Wed Jul 27 08:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:39:29.675645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad72d-08b2-4d8d-b493-18bf51cf5975 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.686106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:29.740419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad72d-08b2-4d8d-b493-18bf51cf5975 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.746040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2429e-2733-4371-b3d6-7f2fd186561b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.747247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2429e-2733-4371-b3d6-7f2fd186561b service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.747538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2429e-2733-4371-b3d6-7f2fd186561b service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.747820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2429e-2733-4371-b3d6-7f2fd186561b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.758248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2429e-2733-4371-b3d6-7f2fd186561b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.761504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2429e-2733-4371-b3d6-7f2fd186561b service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.772905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 809/1616] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:29.773747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.775343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.777992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 808/1617] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:29.779733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.780034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.780395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.820682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:29.822045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:29.834568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591b72a-78bf-4ebf-a490-de5a7aa7a1f7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.838282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.838911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.839194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.839472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.891196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 809/1618] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:29.892341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.902130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597c819-518f-4aa8-8ce7-58e5a1ecce16 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.906301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56988952-491a-481c-9012-05b49405156d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.906675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988952-491a-481c-9012-05b49405156d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.916415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988952-491a-481c-9012-05b49405156d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.916415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988952-491a-481c-9012-05b49405156d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.916765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.917117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.917937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56988952-491a-481c-9012-05b49405156d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.919531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56988952-491a-481c-9012-05b49405156d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.928711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 810/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:29.929658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.931727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 810/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:29.932542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56988952-491a-481c-9012-05b49405156d service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:29.940126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e730-c1c6-4b95-b8a0-021bd3b819e6 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.945509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.946493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56988952-491a-481c-9012-05b49405156d service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:29.946615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.946776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.947178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:29.948074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:29.950108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:29.952804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:29.953549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:29.954098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:29.954213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.055625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 811/1621] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:29 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:30.056628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:30.058432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.060182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.070750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d63613-0dc0-4969-bf23-b1c172df8c48 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:30.072130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 811/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:30.077052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:30.077711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.077992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.082321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.082321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.082321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.094384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 812/1623] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:30.096436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:30.108112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08520437-2732-4260-ba5e-bf87440bb64b service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:30.115974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:30.116878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.117260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.117634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] PATH_INFO: `/v3/projects/b8e7c526bd0043b9a4c0ca19bf34af11/users/4595dabb20af46f3bfcc1460abf3170e/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.139939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e7c526bd0043b9a4c0ca19bf34af11, user_id=4595dabb20af46f3bfcc1460abf3170e, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.143759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.213579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:30.229118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 812/1624] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:30 2022] PUT /identity/v3/projects/b8e7c526bd0043b9a4c0ca19bf34af11/users/4595dabb20af46f3bfcc1460abf3170e/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:30.233503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:30.254059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4c8d-9d0c-4e0a-b8f7-e400baec3382 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:30.347026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237df6e3-73af-4d74-ae12-8a0c000350ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:30.347881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237df6e3-73af-4d74-ae12-8a0c000350ec admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.348388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237df6e3-73af-4d74-ae12-8a0c000350ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.348817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237df6e3-73af-4d74-ae12-8a0c000350ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.350710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237df6e3-73af-4d74-ae12-8a0c000350ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.352800 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237df6e3-73af-4d74-ae12-8a0c000350ec admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.381303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 813/1625] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:30.383032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:30.396466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020448d8-e541-4dc4-a2d8-d8ee6288813d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:30.407787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23a0c-a7e5-4415-8374-d6d975894f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:30.410559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23a0c-a7e5-4415-8374-d6d975894f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.410559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23a0c-a7e5-4415-8374-d6d975894f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.410559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23a0c-a7e5-4415-8374-d6d975894f11 admin admin] PATH_INFO: `/v3/projects/b8e7c526bd0043b9a4c0ca19bf34af11/users/4595dabb20af46f3bfcc1460abf3170e/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.415610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23a0c-a7e5-4415-8374-d6d975894f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e7c526bd0043b9a4c0ca19bf34af11, user_id=4595dabb20af46f3bfcc1460abf3170e, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.418395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23a0c-a7e5-4415-8374-d6d975894f11 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.463279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 813/1626] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:30 2022] PUT /identity/v3/projects/b8e7c526bd0043b9a4c0ca19bf34af11/users/4595dabb20af46f3bfcc1460abf3170e/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:30.474067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.474613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.475101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.529222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] MFA Rules not processed for user `4595dabb20af46f3bfcc1460abf3170e`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:30.530464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:30.551490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:30.622153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1c1b-4d9c-4079-82df-5f646dfb8133 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.622496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1c1b-4d9c-4079-82df-5f646dfb8133 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.622777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1c1b-4d9c-4079-82df-5f646dfb8133 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.625049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 814/1627] 10.222.0.60 () {54 vars in 912 bytes} [Wed Jul 27 08:39:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:39:30.634155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.634440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.634771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.694046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:30.695774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:30.732088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 814/1628] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:30.749129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:30.858546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 815/1629] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:39:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:30.863376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975ade-c506-4b41-b95c-d1c5b3f8e54f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:30.874290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:30.882264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:30.883492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.883492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.883706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.890231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b5b48-6955-4655-8235-e7a08e5d4d22 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:30.897995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401676-986e-4a2c-adba-adfe635157b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:30.898780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401676-986e-4a2c-adba-adfe635157b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:30.899138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401676-986e-4a2c-adba-adfe635157b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:30.899521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401676-986e-4a2c-adba-adfe635157b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:30.903166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.906849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.924755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401676-986e-4a2c-adba-adfe635157b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:30.926455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401676-986e-4a2c-adba-adfe635157b2 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:30.931591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 815/1630] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:39:30.958731 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 816/1631] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:31.300313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:31.309119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1aca7-e68a-4d51-a1c6-b977817f74ed service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:31.322434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8492-3d01-42f8-9294-d308f3df5e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:31.325397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8492-3d01-42f8-9294-d308f3df5e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:31.325397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8492-3d01-42f8-9294-d308f3df5e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:31.325397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8492-3d01-42f8-9294-d308f3df5e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:31.395633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8492-3d01-42f8-9294-d308f3df5e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:31.398008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8492-3d01-42f8-9294-d308f3df5e42 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:31.424907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 816/1632] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:32.604322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dc4c-554d-42fe-9083-8936e23418ad None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:32.605321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dc4c-554d-42fe-9083-8936e23418ad None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:32.605321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dc4c-554d-42fe-9083-8936e23418ad None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:32.606566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 817/1633] 10.222.0.60 () {54 vars in 962 bytes} [Wed Jul 27 08:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:39:32.614982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d8dfa-4f45-454a-a3f8-e5263b283d75 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:32.615746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d8dfa-4f45-454a-a3f8-e5263b283d75 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:32.616200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d8dfa-4f45-454a-a3f8-e5263b283d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:32.680340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3e2d8dfa-4f45-454a-a3f8-e5263b283d75 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:32.681600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3e2d8dfa-4f45-454a-a3f8-e5263b283d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:32.691804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 817/1634] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Jul 27 08:39:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:32.697885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349f5c0-529e-45e1-a80d-912423fc5617 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:32.698157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349f5c0-529e-45e1-a80d-912423fc5617 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:32.698434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349f5c0-529e-45e1-a80d-912423fc5617 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:32.700000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 818/1635] 10.222.0.60 () {54 vars in 912 bytes} [Wed Jul 27 08:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:39:32.705732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:32.706096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:32.706425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:32.727841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:32.729126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:32.739444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 818/1636] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:39:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:32.753634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349f5c0-529e-45e1-a80d-912423fc5617 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:32.779086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349f5c0-529e-45e1-a80d-912423fc5617 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:32.786134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee6bb7-88ca-4a8d-8ef9-26ae0fb6778c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:32.787392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee6bb7-88ca-4a8d-8ef9-26ae0fb6778c service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:32.787894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee6bb7-88ca-4a8d-8ef9-26ae0fb6778c service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:32.788308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee6bb7-88ca-4a8d-8ef9-26ae0fb6778c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:32.821850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee6bb7-88ca-4a8d-8ef9-26ae0fb6778c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:32.823377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee6bb7-88ca-4a8d-8ef9-26ae0fb6778c service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:32.849846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 819/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:40.162016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:40.184302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:40.272151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf55faa-fd05-4e6c-829c-3ffd6406897f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:40.277877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:40.280520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:40.280520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:40.280520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] PATH_INFO: `/v3/users/53c912fe13594cad95d473eb98174f23` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:40.281580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c912fe13594cad95d473eb98174f23)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:40.283727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: WARNING py.warnings [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:39:40.283727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: warnings.warn(msg) Jul 27 08:39:40.283727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: Jul 27 08:39:40.285396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:40.589536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c912fe13594cad95d473eb98174f23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:40.681508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c912fe13594cad95d473eb98174f23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:40.705606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c912fe13594cad95d473eb98174f23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:40.708760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c912fe13594cad95d473eb98174f23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:40.714333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c912fe13594cad95d473eb98174f23'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:40.793226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 819/1638] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:39:40 2022] DELETE /identity/v3/users/53c912fe13594cad95d473eb98174f23 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:40.798030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2785-081f-4c47-bfe4-346492eb44a6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:40.799643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2785-081f-4c47-bfe4-346492eb44a6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:40.800360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2785-081f-4c47-bfe4-346492eb44a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:40.862873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ab0f2785-081f-4c47-bfe4-346492eb44a6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:40.864318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ab0f2785-081f-4c47-bfe4-346492eb44a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:41.013796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 820/1639] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:41.144420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:41.146778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:41.288162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6228-8faa-43e1-9051-fe4d728d3f99 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:41.316782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:41.317392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:41.317837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:41.318266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:41.343131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:41.347348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:41.381175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 820/1640] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:43.517670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:43.518532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:43.518950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:43.603121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] MFA Rules not processed for user `f5ab7ab8489b45c3af75187da20695af`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:43.604923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:43.710510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:43.879800 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:43.879800 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:43.881815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 821/1641] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:43.934046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:43.935640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:43.963416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be091e-bbf8-4453-9c7d-fad6b8e55174 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:43.982463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:43.983385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:43.985100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:43.992264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] PATH_INFO: `/v3/users/fa117823f316456dbec083d3a04d9dc4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:43.992264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa117823f316456dbec083d3a04d9dc4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:44.001396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:44.009140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:44.093321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29946e8-6267-41cf-b2f2-2d3c19dbca24 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:44.100416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:44.101397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:44.101980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:44.102542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:44.112507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:44.114507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:44.135733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 821/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:39:44.137087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:44.141062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:44.198327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f3c7d-b86e-4e9c-a525-7f1a9e2333c9 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:44.212507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:44.214240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:44.214532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:44.217692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] PATH_INFO: `/v3/users/0396663dd5344f779feba05636e12ee7` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:44.217913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0396663dd5344f779feba05636e12ee7)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:44.224008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:44.334475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa117823f316456dbec083d3a04d9dc4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.341429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa117823f316456dbec083d3a04d9dc4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.366585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa117823f316456dbec083d3a04d9dc4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.436825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa117823f316456dbec083d3a04d9dc4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.438540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa117823f316456dbec083d3a04d9dc4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.537460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0396663dd5344f779feba05636e12ee7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.562114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 822/1643] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:39:43 2022] DELETE /identity/v3/users/fa117823f316456dbec083d3a04d9dc4 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:44.568167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:44.572493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:44.617595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0396663dd5344f779feba05636e12ee7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.632427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0396663dd5344f779feba05636e12ee7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.633570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0396663dd5344f779feba05636e12ee7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.634270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-45b49241-2150-4dec-9bbf-cb3d5272f1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0396663dd5344f779feba05636e12ee7'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:44.676529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 822/1644] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:39:44 2022] DELETE /identity/v3/users/0396663dd5344f779feba05636e12ee7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:44.684456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c63cd-c41a-42a4-839e-9110e9a8c043 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:44.687133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c63cd-c41a-42a4-839e-9110e9a8c043 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:44.687555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c63cd-c41a-42a4-839e-9110e9a8c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:44.773852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a93c63cd-c41a-42a4-839e-9110e9a8c043 None None] MFA Rules not processed for user `8737247b374f45338fa9370dac461835`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:44.780741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a93c63cd-c41a-42a4-839e-9110e9a8c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:44.797197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87c2a3-dcb3-4d5f-bb11-f9c4d9edea41 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:45.009499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 823/1645] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:45.010875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697f663-e0c9-476c-9a5e-d8517029a056 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.011162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697f663-e0c9-476c-9a5e-d8517029a056 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.011437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697f663-e0c9-476c-9a5e-d8517029a056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.026562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:45.027329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.028191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.028490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] PATH_INFO: `/v3/projects/914119bc9357473ebf64d037b8f726b6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.030082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914119bc9357473ebf64d037b8f726b6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:45.031311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: WARNING py.warnings [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:39:45.031311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: warnings.warn(msg) Jul 27 08:39:45.031311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: Jul 27 08:39:45.037674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:45.067011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8697f663-e0c9-476c-9a5e-d8517029a056 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:45.068511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8697f663-e0c9-476c-9a5e-d8517029a056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.092083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 824/1646] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:45.099994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0115e-2b05-4b69-9bac-31597ceca105 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.099994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0115e-2b05-4b69-9bac-31597ceca105 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.099994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0115e-2b05-4b69-9bac-31597ceca105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.137279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bfc0115e-2b05-4b69-9bac-31597ceca105 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:45.138732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bfc0115e-2b05-4b69-9bac-31597ceca105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.159386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 825/1647] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:45.161264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.161753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.162227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.206066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] MFA Rules not processed for user `8737247b374f45338fa9370dac461835`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:45.207547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.233881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914119bc9357473ebf64d037b8f726b6', 'request_id': 'req-d7a7be11-2199-48e4-8eb8-4aef4c527d72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:45.284446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:45.290818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914119bc9357473ebf64d037b8f726b6', 'request_id': 'req-d7a7be11-2199-48e4-8eb8-4aef4c527d72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:45.323436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914119bc9357473ebf64d037b8f726b6', 'request_id': 'req-d7a7be11-2199-48e4-8eb8-4aef4c527d72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:45.344378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 826/1648] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:45.346548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:45.352794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.422709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] The token cache is being invalidate because project 914119bc9357473ebf64d037b8f726b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:39:45.422709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:45.423916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:45.431370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 823/1649] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:39:44 2022] DELETE /identity/v3/projects/914119bc9357473ebf64d037b8f726b6 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:45.432389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:45.437446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.477382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8b791-e684-4877-ba56-7c20d30e7917 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:45.485854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:45.487225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.488706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.489251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.493719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.563842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7be11-2199-48e4-8eb8-4aef4c527d72 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:45.575105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:45.576102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.579078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.579623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.584535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.647167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:45.649500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:45.666706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 827/1650] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:45.668174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:45.670166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.752790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:45.757453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5c379-0ed0-40ec-b211-b4f8ba3b98c5 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:45.833806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 824/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:45.835347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.836014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.836546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.837354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e8784-c435-4180-aad4-6d064c23c7ab service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:45.847500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:45.848493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.848902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.849318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.851675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.868559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:45.870556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32ef1-51b8-47f5-9986-180d4927a3c4 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:45.883396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:45.884929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 828/1652] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:45.885347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:45.918332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 825/1653] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:45.920345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:45.923169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:45.923169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:45.973277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:45.974743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:46.005061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 829/1654] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:46.006321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.026463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1798-499b-4f77-9211-d06e854a4974 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:46.034056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:46.035549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.035947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.036341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.041657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:46.042124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:46.043904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:46.080429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 826/1655] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:46.089854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.115123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b59b-58ac-4600-bbe1-5dbc163a3de0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:46.121536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:46.139306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:46.140008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.140300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.140580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.141847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:46.144091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:46.296335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 830/1656] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:46 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:46.299858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.311250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb10e-b045-44d9-905c-e17301e69316 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:46.448040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:46.448799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.449301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.449761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.450648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:46.452883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:46.555608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 827/1657] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:46 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:39:46.560628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.583201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53af862-b958-4c77-b2c1-d7397ecc8ec2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:46.589211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3ac05-b635-412c-92fe-25fbb5cac31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:46.590265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ac05-b635-412c-92fe-25fbb5cac31f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.590723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ac05-b635-412c-92fe-25fbb5cac31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.591170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ac05-b635-412c-92fe-25fbb5cac31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.592157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ac05-b635-412c-92fe-25fbb5cac31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:46.597300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ac05-b635-412c-92fe-25fbb5cac31f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:46.623801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 831/1658] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:46.627992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.653511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.653802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.654081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.654623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaac5cf-2194-4365-8483-a58ee63f6afb admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:46.660587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:46.663740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.663740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.663740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.663740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:46.665679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:46.683220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 828/1659] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:46.697208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.722350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167d6c9-b8c5-4ec8-a526-a5fa0e765b44 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:46.728579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935492-020d-467f-9bb6-be810922e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:46.730413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935492-020d-467f-9bb6-be810922e0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.730933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935492-020d-467f-9bb6-be810922e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.731417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935492-020d-467f-9bb6-be810922e0b1 admin admin] PATH_INFO: `/v3/projects/ae859d73d56d49c9ab108ee67f2bedf1/users/9d70869325494b95bdd8ec5b8f5737bc/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.753596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] MFA Rules not processed for user `4d4013ba9eca412b81585544a52e38ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:46.754840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:46.767894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9935492-020d-467f-9bb6-be810922e0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae859d73d56d49c9ab108ee67f2bedf1, user_id=9d70869325494b95bdd8ec5b8f5737bc, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:46.773320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9935492-020d-467f-9bb6-be810922e0b1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:46.898359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 829/1660] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:46 2022] PUT /identity/v3/projects/ae859d73d56d49c9ab108ee67f2bedf1/users/9d70869325494b95bdd8ec5b8f5737bc/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:46.911338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936b513-2c59-440e-895a-0415c7b7fd9e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:46.911923 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936b513-2c59-440e-895a-0415c7b7fd9e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:46.912437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936b513-2c59-440e-895a-0415c7b7fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:46.947758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 832/1661] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:46.962615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:46.966617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:47.020529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:47.022263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2936b513-2c59-440e-895a-0415c7b7fd9e None None] MFA Rules not processed for user `9d70869325494b95bdd8ec5b8f5737bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:47.023677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2936b513-2c59-440e-895a-0415c7b7fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:47.250665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfdae2-1475-4fea-bfad-a6a9aff0f5ba None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:47.268356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 830/1662] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:47.270150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620342-c599-47a7-961c-88518232acee None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:47.270547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620342-c599-47a7-961c-88518232acee None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:47.271354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88620342-c599-47a7-961c-88518232acee None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:47.293619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 831/1663] 10.222.0.60 () {54 vars in 912 bytes} [Wed Jul 27 08:39:47 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:39:47.294600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88620342-c599-47a7-961c-88518232acee None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:47.300527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-88620342-c599-47a7-961c-88518232acee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:47.480921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:47.482123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:47.482472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:47.482758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:47.524444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88620342-c599-47a7-961c-88518232acee None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:47.537933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:47.540719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:47.541238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:47.545286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] PATH_INFO: `/v3/projects/e68479247fd14dc98aa1d8c9824800d4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:47.549451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68479247fd14dc98aa1d8c9824800d4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:47.551701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:47.659539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:47.661623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:47.663957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:47.692511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 833/1664] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:47.693729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:47.727704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1f21-941e-4dff-86d3-457dfdcb67c4 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:47.738036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68479247fd14dc98aa1d8c9824800d4', 'request_id': 'req-5059aa66-b53c-4696-84a7-cd84d3834e21'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:47.765909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68479247fd14dc98aa1d8c9824800d4', 'request_id': 'req-5059aa66-b53c-4696-84a7-cd84d3834e21'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:47.790641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68479247fd14dc98aa1d8c9824800d4', 'request_id': 'req-5059aa66-b53c-4696-84a7-cd84d3834e21'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:47.892987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] The token cache is being invalidate because project e68479247fd14dc98aa1d8c9824800d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:39:47.892987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:47.892987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5059aa66-b53c-4696-84a7-cd84d3834e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:47.893703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 832/1665] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:39:47 2022] DELETE /identity/v3/projects/e68479247fd14dc98aa1d8c9824800d4 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:47.894730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:47.895033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:47.895320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:47.927931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56222-1a3c-4c40-ac3a-f25efb57c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:47.928586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56222-1a3c-4c40-ac3a-f25efb57c680 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:47.929055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56222-1a3c-4c40-ac3a-f25efb57c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:47.929494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56222-1a3c-4c40-ac3a-f25efb57c680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:47.930775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda56222-1a3c-4c40-ac3a-f25efb57c680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:47.932925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda56222-1a3c-4c40-ac3a-f25efb57c680 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:48.002159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] MFA Rules not processed for user `aefebccee9e74e91a48485fa6f074698`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:48.007204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.076308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 834/1666] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:47 2022] POST /identity/v3/projects => generated 363 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:48.077865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.078641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.079175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.097399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 833/1667] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:39:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:48.100161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:48.102947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.141338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:48.145385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.151097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af126d-9156-4e92-83bb-4803dc16db4e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:48.163301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:48.304058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:48.304440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.304694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.305004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] PATH_INFO: `/v3/projects/2079dc00d7c84827ba0c08549ffbdafd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.312770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 835/1668] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:48.317012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2079dc00d7c84827ba0c08549ffbdafd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:48.320450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:48.323045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.323705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:48.336879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ac74-361b-4dbb-96b3-7ae86537e56c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:48.343424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4c2e4-31c0-4d6b-b72b-30dd863d0d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:48.344137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c2e4-31c0-4d6b-b72b-30dd863d0d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.344490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c2e4-31c0-4d6b-b72b-30dd863d0d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.345597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c2e4-31c0-4d6b-b72b-30dd863d0d1f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.346412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4c2e4-31c0-4d6b-b72b-30dd863d0d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:48.348898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4c2e4-31c0-4d6b-b72b-30dd863d0d1f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:48.456208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 836/1669] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:48 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:48.460966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026cfb-e9bd-41a6-b092-6a7d53489af2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.462663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026cfb-e9bd-41a6-b092-6a7d53489af2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.462994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026cfb-e9bd-41a6-b092-6a7d53489af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.467119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:48.504326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2079dc00d7c84827ba0c08549ffbdafd', 'request_id': 'req-db06f185-c661-47c6-be18-6c199338858f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:48.517244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2079dc00d7c84827ba0c08549ffbdafd', 'request_id': 'req-db06f185-c661-47c6-be18-6c199338858f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:48.535377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2079dc00d7c84827ba0c08549ffbdafd', 'request_id': 'req-db06f185-c661-47c6-be18-6c199338858f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:48.540127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-62026cfb-e9bd-41a6-b092-6a7d53489af2 None None] MFA Rules not processed for user `a1303857db364b2991017d1a39d8f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:48.541447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-62026cfb-e9bd-41a6-b092-6a7d53489af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.607067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] The token cache is being invalidate because project 2079dc00d7c84827ba0c08549ffbdafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:39:48.607765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:48.608744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-db06f185-c661-47c6-be18-6c199338858f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:48.612508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 834/1670] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:39:48 2022] DELETE /identity/v3/projects/2079dc00d7c84827ba0c08549ffbdafd => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:48.618385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.620176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.620685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.698945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] MFA Rules not processed for user `63fa285fd1e14d41977a6cd0ceaabb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:48.700181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.728268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 837/1671] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:48.730596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.731857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.732347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.793546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:48.795410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.837378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 835/1672] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:48.838408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:48.849021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.894814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 838/1673] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:48.895930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:48.899435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.930911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899d469-ccf7-4961-aaf8-7f09529b55d7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:48.941459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:48.942346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.942775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.943193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.944104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:48.945913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:48.950402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b52bb9-63ea-4023-9eda-ecbc9151c7b0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:48.958974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 839/1674] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:48.968103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:48.970713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:48.971496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:48.971846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:48.972127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:48.975094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.976676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:48.992509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf6f9-bb8d-41da-a402-fa73174c623a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:48.994708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:48.997015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:48.998777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:48.999665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.000126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.000543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] PATH_INFO: `/v3/users/4595dabb20af46f3bfcc1460abf3170e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.002807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4595dabb20af46f3bfcc1460abf3170e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.004956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.026948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 836/1675] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:49.027605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.029099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:49.198676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cf09-1f8c-47ab-836e-39b71cf11aea service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.207538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6227d6-cc94-499e-9267-c5c67a7381e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.208298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6227d6-cc94-499e-9267-c5c67a7381e5 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.216976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6227d6-cc94-499e-9267-c5c67a7381e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.216976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6227d6-cc94-499e-9267-c5c67a7381e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.218690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6227d6-cc94-499e-9267-c5c67a7381e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.220418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6227d6-cc94-499e-9267-c5c67a7381e5 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.231841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 837/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:49.255200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.256017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.260583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.284813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4595dabb20af46f3bfcc1460abf3170e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:49.303473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:49.325472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] MFA Rules not processed for user `63fa285fd1e14d41977a6cd0ceaabb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:49.326742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:49.350973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 838/1677] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:49.355596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.366496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4595dabb20af46f3bfcc1460abf3170e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:49.373525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b03d5-7e15-40af-99b7-e5d2d1782066 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.377645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4595dabb20af46f3bfcc1460abf3170e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:49.378745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4595dabb20af46f3bfcc1460abf3170e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:49.380077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4595dabb20af46f3bfcc1460abf3170e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:49.386878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.387584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.387943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.388159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.388911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:49.389223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.390883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.409094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 840/1678] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:39:48 2022] DELETE /identity/v3/users/4595dabb20af46f3bfcc1460abf3170e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:49.410249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.411890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:49.427524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 839/1679] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:49.432114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.434470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:49.460373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f997-263d-48d9-b15f-dcd0b1ac8632 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.564246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aca436-c761-4aeb-b8f8-8022381e014a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.564456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.565558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.566684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.566973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.568601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.572230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.573458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.574844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.575288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.575701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] PATH_INFO: `/v3/projects/9e728a1aabdf4f33ae98920cb8b45296/users/42c5e566530d4c50aca6aaac2a02f86c/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.593192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e728a1aabdf4f33ae98920cb8b45296, user_id=42c5e566530d4c50aca6aaac2a02f86c, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.597029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.673363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 841/1680] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:49 2022] PUT /identity/v3/projects/9e728a1aabdf4f33ae98920cb8b45296/users/42c5e566530d4c50aca6aaac2a02f86c/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:49.674509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.679472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 840/1681] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:49 2022] POST /identity/v3/projects => generated 357 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:39:49.683614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:49.684124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.818064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72e8cd-e71c-4e50-859e-af91d87424b5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.823595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:49.827787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.829451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.830195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.830632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.831612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.834352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.855476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 841/1682] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:49.855476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:49.856110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfa525-cfe2-455d-93e2-78eb0ba9ffc1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.868798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1782dd-684f-48d0-998a-4f086b3f88ac admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:49.883374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.889082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.889082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.889082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.889082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:49.893667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:49.947023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:49.947667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:49.947946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:49.948218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:49.950256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:50.021184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 842/1683] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:49 2022] POST /identity/v3/users => generated 279 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:50.025405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:50.065771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90888-78b7-40b6-8399-64cacb35fd61 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:50.075973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:50.081961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:50.092275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ec375-5ec1-418c-80d1-2f56f032b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:50.096117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec375-5ec1-418c-80d1-2f56f032b67a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.096425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec375-5ec1-418c-80d1-2f56f032b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.098852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec375-5ec1-418c-80d1-2f56f032b67a admin admin] PATH_INFO: `/v3/projects/9e728a1aabdf4f33ae98920cb8b45296/users/42c5e566530d4c50aca6aaac2a02f86c/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.107872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 842/1684] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:50.107872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:50.122313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ec375-5ec1-418c-80d1-2f56f032b67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e728a1aabdf4f33ae98920cb8b45296, user_id=42c5e566530d4c50aca6aaac2a02f86c, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:50.128523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ec375-5ec1-418c-80d1-2f56f032b67a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:50.140049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52683c9-e68c-44e1-9c2c-8a1b943f5d43 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:50.154252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:50.155079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.155722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.156154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.157213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:50.159475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:50.185759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 843/1685] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:50.190394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:50.203899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 843/1686] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:50 2022] PUT /identity/v3/projects/9e728a1aabdf4f33ae98920cb8b45296/users/42c5e566530d4c50aca6aaac2a02f86c/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:50.212420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920550f-7863-4a3e-afef-83e8d1d7ae91 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:50.215748 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9d53-631a-4b79-b6f2-0430bbfa5265 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.216037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9d53-631a-4b79-b6f2-0430bbfa5265 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.216317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9d53-631a-4b79-b6f2-0430bbfa5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.343687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-cfeb9d53-631a-4b79-b6f2-0430bbfa5265 None None] MFA Rules not processed for user `42c5e566530d4c50aca6aaac2a02f86c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:50.348301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cfeb9d53-631a-4b79-b6f2-0430bbfa5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:50.380638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bbb99-f9e2-49a4-aa56-30104237593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:50.381489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bbb99-f9e2-49a4-aa56-30104237593e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.381871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bbb99-f9e2-49a4-aa56-30104237593e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.382242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bbb99-f9e2-49a4-aa56-30104237593e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.383252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bbb99-f9e2-49a4-aa56-30104237593e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:50.386885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bbb99-f9e2-49a4-aa56-30104237593e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:50.418176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 844/1687] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:50.419555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154da74-1c34-4278-931f-ce61acdfde2f None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.423504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154da74-1c34-4278-931f-ce61acdfde2f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.423504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154da74-1c34-4278-931f-ce61acdfde2f None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.423504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 845/1688] 10.222.0.60 () {54 vars in 961 bytes} [Wed Jul 27 08:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:39:50.423504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154da74-1c34-4278-931f-ce61acdfde2f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:50.435804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154da74-1c34-4278-931f-ce61acdfde2f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:50.442783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:50.443468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.457020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:50.457645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.457931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] PATH_INFO: `/v3/projects/ac35c6b05b2a4b35a8ecb4c78d5f1198/users/2fc1cd6bf5fa4ec786814d3e48a7d1ba/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.475484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac35c6b05b2a4b35a8ecb4c78d5f1198, user_id=2fc1cd6bf5fa4ec786814d3e48a7d1ba, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:50.478836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:50.558813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 844/1689] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:50.560352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336c40e-498b-4ce1-8257-8896194b2e0f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.560882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336c40e-498b-4ce1-8257-8896194b2e0f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.561166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336c40e-498b-4ce1-8257-8896194b2e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.588069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0336c40e-498b-4ce1-8257-8896194b2e0f None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:50.589531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0336c40e-498b-4ce1-8257-8896194b2e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:50.590415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 846/1690] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:50 2022] PUT /identity/v3/projects/ac35c6b05b2a4b35a8ecb4c78d5f1198/users/2fc1cd6bf5fa4ec786814d3e48a7d1ba/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:50.591735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:50.600028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:50.768930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb812e8-3187-4fa9-bdfb-35452569b874 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:50.770270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 845/1691] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Jul 27 08:39:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:50.773085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9dce-01c7-4f10-9e16-59c8034e24ba None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.773191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9dce-01c7-4f10-9e16-59c8034e24ba None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.773718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca9dce-01c7-4f10-9e16-59c8034e24ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.776467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:50.777561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:50.778203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:50.778692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:50.842787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4eca9dce-01c7-4f10-9e16-59c8034e24ba None None] MFA Rules not processed for user `2fc1cd6bf5fa4ec786814d3e48a7d1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:50.844071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4eca9dce-01c7-4f10-9e16-59c8034e24ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:50.924549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:50.926165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:50.939414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 847/1692] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:50.940335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:50.942121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:51.018775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 846/1693] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:50 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:51.019261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.019261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.022391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.100224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] MFA Rules not processed for user `f5ab7ab8489b45c3af75187da20695af`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:51.100224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:51.131535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ce50c-c083-47a2-9471-21a2fdc9f5f7 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:51.148089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:51.149108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.149108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.149557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] PATH_INFO: `/v3/projects/b8e7c526bd0043b9a4c0ca19bf34af11` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.151356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e7c526bd0043b9a4c0ca19bf34af11)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:51.153931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:51.236616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 847/1694] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:51.240598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:51.291577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6734a-9188-4cbd-9eb0-e286edaa759e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:51.300642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:51.304886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.305343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.305708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.313737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:51.350637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e7c526bd0043b9a4c0ca19bf34af11', 'request_id': 'req-7b3ff272-2d31-4111-afb1-6b78c497d3aa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:51.359093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:51.363740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:51.368693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e7c526bd0043b9a4c0ca19bf34af11', 'request_id': 'req-7b3ff272-2d31-4111-afb1-6b78c497d3aa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:51.386089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e7c526bd0043b9a4c0ca19bf34af11', 'request_id': 'req-7b3ff272-2d31-4111-afb1-6b78c497d3aa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:51.389615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 848/1695] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:51.391974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:51.406159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ec88c-9ea2-4fa7-a42e-a03df0c04e8a service placement] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:51.475689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5fcd-3a31-4c99-87a5-778a090d6266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:51.476576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5fcd-3a31-4c99-87a5-778a090d6266 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.476894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5fcd-3a31-4c99-87a5-778a090d6266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.477173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5fcd-3a31-4c99-87a5-778a090d6266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.477856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5fcd-3a31-4c99-87a5-778a090d6266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:51.480556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5fcd-3a31-4c99-87a5-778a090d6266 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:51.553623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] The token cache is being invalidate because project b8e7c526bd0043b9a4c0ca19bf34af11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:39:51.555088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:51.567939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7b3ff272-2d31-4111-afb1-6b78c497d3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:51.577803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 848/1696] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:39:50 2022] DELETE /identity/v3/projects/b8e7c526bd0043b9a4c0ca19bf34af11 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:51.579570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b84a4-f5e5-4ee1-97ab-d0157e1f18cf None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.580348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b84a4-f5e5-4ee1-97ab-d0157e1f18cf None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.580803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b84a4-f5e5-4ee1-97ab-d0157e1f18cf None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.586135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 849/1697] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:51 2022] POST /identity/v3/projects => generated 357 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:51.588122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.588418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.588702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.591061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 849/1698] 10.222.0.60 () {54 vars in 912 bytes} [Wed Jul 27 08:39:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:39:51.594882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:51.595611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:51.596859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:51.611664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:51.650035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] MFA Rules not processed for user `aefebccee9e74e91a48485fa6f074698`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:51.651803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:51.687976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:51.693880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:51.840620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 850/1699] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:39:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:51.841753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:51.848026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:51.985979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 850/1700] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:51.986138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:51.997912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:52.027634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71ab4-eb7e-49a8-803e-240efb1e992f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.036779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4d0c-9805-4f7c-bd8f-49b7891b6de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.042951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4d0c-9805-4f7c-bd8f-49b7891b6de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.042951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4d0c-9805-4f7c-bd8f-49b7891b6de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.042951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4d0c-9805-4f7c-bd8f-49b7891b6de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.056119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4d0c-9805-4f7c-bd8f-49b7891b6de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.064271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4d0c-9805-4f7c-bd8f-49b7891b6de3 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.067855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525b80d-c086-4379-a794-f0c4bd8251f8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.091834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.092484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.094156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.094974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.099939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.106038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.106895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 851/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:52.108335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.111473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.112460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.160081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:52.162331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:52.173955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 852/1702] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:52.177942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.202785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2b0d6-5ddb-4593-a035-df449610d1bf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.221326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.223427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.224367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.225158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.229725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:39:52.230198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.232882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.255185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 851/1703] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:51 2022] POST /identity/v3/users => generated 285 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:52.263432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.283837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485d7c-35a2-45d4-b8a4-58bec1ce4a4f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.288870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 853/1704] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:39:52.296305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.309603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.310394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.310705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.311220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.316235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6353-b383-4395-8e79-c44e23d104fe admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.316857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.319778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.336252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.337293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.337681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.338062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.339014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.341910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.345741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 852/1705] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:39:52.350200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.380616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b88ed-a406-48aa-a535-9e037968f472 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.408708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.410190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.411684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.412253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] PATH_INFO: `/v3/projects/110fe825687f4741b2be2b3e43744b53/users/22761ac999e943c2a11cda89a18095f9/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.416620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:52.446586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=110fe825687f4741b2be2b3e43744b53, user_id=22761ac999e943c2a11cda89a18095f9, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.450529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.523932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 854/1706] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:52 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:52.533082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.615421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 853/1707] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:52 2022] PUT /identity/v3/projects/110fe825687f4741b2be2b3e43744b53/users/22761ac999e943c2a11cda89a18095f9/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:52.619654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.719528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646b4d-ccc4-4574-b11f-e86b3a357b43 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.858012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ab92-87bc-4b5e-ac6a-62cd96a9cd5a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:52.874361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.877706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.878003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.878281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.879021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.895715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.936715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44297aa-15c8-4bb2-9df5-40250edcafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:52.937588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44297aa-15c8-4bb2-9df5-40250edcafc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:52.938065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44297aa-15c8-4bb2-9df5-40250edcafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:52.938573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44297aa-15c8-4bb2-9df5-40250edcafc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:52.939739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44297aa-15c8-4bb2-9df5-40250edcafc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:52.945463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44297aa-15c8-4bb2-9df5-40250edcafc5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:52.945675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 854/1708] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:39:52.946532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:52.952703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:52.987663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cd55f-a545-46bd-b72a-f059194cfce7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:53.006539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:53.010715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:53.011052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:53.011445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] PATH_INFO: `/v3/users/9d70869325494b95bdd8ec5b8f5737bc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:53.012657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d70869325494b95bdd8ec5b8f5737bc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:53.016049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:53.060395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 855/1709] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:52 2022] POST /identity/v3/users => generated 282 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:39:53.062173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:53.062173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:53.064339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:53.129081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] MFA Rules not processed for user `4d4013ba9eca412b81585544a52e38ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:53.131171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:53.272669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 856/1710] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:53.274300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:53.278813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d70869325494b95bdd8ec5b8f5737bc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:53.368672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8c8e-740a-4dcb-846d-ab3dd8222b55 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:53.389440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:53.390395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:53.390880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:53.392204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] PATH_INFO: `/v3/projects/110fe825687f4741b2be2b3e43744b53/users/22761ac999e943c2a11cda89a18095f9/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:53.411102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=110fe825687f4741b2be2b3e43744b53, user_id=22761ac999e943c2a11cda89a18095f9, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:53.411345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d70869325494b95bdd8ec5b8f5737bc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:53.414794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:53.419768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d70869325494b95bdd8ec5b8f5737bc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:53.420867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d70869325494b95bdd8ec5b8f5737bc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:53.421788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7237ccda-306e-4012-9c3e-581ac9c7d1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d70869325494b95bdd8ec5b8f5737bc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:53.466544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 857/1711] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:53 2022] PUT /identity/v3/projects/110fe825687f4741b2be2b3e43744b53/users/22761ac999e943c2a11cda89a18095f9/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:53.474274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 855/1712] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:39:52 2022] DELETE /identity/v3/users/9d70869325494b95bdd8ec5b8f5737bc => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:53.474529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:53.476240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:53.493628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577c03-d903-4c13-8444-0926974fe872 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:53.497138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577c03-d903-4c13-8444-0926974fe872 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:53.497670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577c03-d903-4c13-8444-0926974fe872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:53.542703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1d577c03-d903-4c13-8444-0926974fe872 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:53.544169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1d577c03-d903-4c13-8444-0926974fe872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:53.691040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83d75d-e27d-420c-8e58-8017221723cf admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:53.716517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 856/1713] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:53.725540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:53.725840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:53.726121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:53.798394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] MFA Rules not processed for user `22761ac999e943c2a11cda89a18095f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:53.801842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:53.835089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:53.835742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:53.836032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:53.836315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:53.837050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:53.842739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:53.875562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:53.920194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 858/1714] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:53.921170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:53.924575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:53.972575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 857/1715] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:53.973670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:53.999305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd2a17-9ce0-48f5-9bf3-18afd9db38e0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:54.001502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:54.002640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.003084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.003512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.004491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:54.007762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:54.026761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 858/1716] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:54.027749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:54.030385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:54.067519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aead14-23a5-4579-86dc-c9335365134a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:54.079604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:54.080252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.080674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.081593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.111841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:54.113767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:54.135254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 859/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:54.136096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:54.158739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dc453-2244-4fd1-830e-1921aff063c1 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:54.170492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750763c1-e89e-4942-8ab5-7db92bb8c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:54.173047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6089e-4940-4475-82e8-a10d08e89a84 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:54.173286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750763c1-e89e-4942-8ab5-7db92bb8c03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.173582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750763c1-e89e-4942-8ab5-7db92bb8c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.173914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750763c1-e89e-4942-8ab5-7db92bb8c03f admin admin] PATH_INFO: `/v3/projects/5997d576be824efcbca65a74c905a4b6/users/b45a666cee1942bd848a70cb57f4d7c0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.182362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab88371-3470-4237-9be5-b069b3e4fc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:54.183079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88371-3470-4237-9be5-b069b3e4fc05 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.183361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88371-3470-4237-9be5-b069b3e4fc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.183636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88371-3470-4237-9be5-b069b3e4fc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.215735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab88371-3470-4237-9be5-b069b3e4fc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:54.219469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750763c1-e89e-4942-8ab5-7db92bb8c03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5997d576be824efcbca65a74c905a4b6, user_id=b45a666cee1942bd848a70cb57f4d7c0, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:54.221936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750763c1-e89e-4942-8ab5-7db92bb8c03f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:54.235822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab88371-3470-4237-9be5-b069b3e4fc05 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:54.318021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 859/1718] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:54 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:54.390944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 860/1719] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:54 2022] PUT /identity/v3/projects/5997d576be824efcbca65a74c905a4b6/users/b45a666cee1942bd848a70cb57f4d7c0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:54.403115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.403115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.403416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.519406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.519821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.520205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.534147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] MFA Rules not processed for user `b45a666cee1942bd848a70cb57f4d7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:54.539791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:54.572794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] MFA Rules not processed for user `63fa285fd1e14d41977a6cd0ceaabb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:54.574299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:54.714345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 861/1720] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:39:54.714345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:54.777643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 860/1721] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:54.781121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:54.866117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:54.889331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2f469-86b1-473a-9b4a-337ce2e2a48c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:54.905988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:54.908400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:54.908789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:54.909114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:54.917974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:54.999993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad7ce4-e4d3-4204-a439-50f04e2f0ce7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:55.019934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:55.026715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:55.027247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:55.027664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:55.030388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:55.039464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:55.131619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:55.135494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:55.160655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 862/1722] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:54 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:55.201090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 861/1723] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:39:54 2022] POST /identity/v3/projects => generated 363 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:39:55.206931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:55.255016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f140b-385f-4826-9f32-eae7f02dbedf service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:55.478688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b114d-b03c-41d6-9d57-523e8abea1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:55.479825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b114d-b03c-41d6-9d57-523e8abea1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:55.480255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b114d-b03c-41d6-9d57-523e8abea1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:55.480671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b114d-b03c-41d6-9d57-523e8abea1ed admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:55.481561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b114d-b03c-41d6-9d57-523e8abea1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:55.487792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b114d-b03c-41d6-9d57-523e8abea1ed admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:55.605316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:55.812469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 863/1724] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:39:55 2022] POST /identity/v3/users => generated 288 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:39:55.815820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:55.880900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:55.885232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:55.885570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf15bb-f2dd-4d10-b95a-70997c5f5388 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:55.886741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:55.910712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:55.911733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:55.912207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:55.919345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:55.924790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:55.930749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:55.934508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] MFA Rules not processed for user `a1303857db364b2991017d1a39d8f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:55.938422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:55.998433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 862/1725] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:39:56.004460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:56.085830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3ad99-39aa-4f01-b197-94b47e9829e7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:56.098929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:56.100880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:56.101169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:56.101451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] PATH_INFO: `/v3/projects/ffd350d0294a4b659409c7ab050c00a7/users/41f801c2671b49dabd74063b481dd5a2/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:56.136179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd350d0294a4b659409c7ab050c00a7, user_id=41f801c2671b49dabd74063b481dd5a2, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:56.144516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:56.167109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 864/1726] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:56.303756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 863/1727] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:56 2022] PUT /identity/v3/projects/ffd350d0294a4b659409c7ab050c00a7/users/41f801c2671b49dabd74063b481dd5a2/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:39:56.307898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:56.335135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0d60c-d7c3-40d7-b20c-e85b95c18088 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:56.569953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:56.570947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:56.571528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:56.572350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:56.573928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:56.576454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:56.632392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:56.633014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 865/1728] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:39:56.653259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a9c32-88b8-4810-9e34-e6de10f07a7a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:56.658039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:56.663496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:56.677374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:56.700418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf26e8b-d5cd-49ac-b069-8dc356db824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:56.702451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf26e8b-d5cd-49ac-b069-8dc356db824b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:56.705148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf26e8b-d5cd-49ac-b069-8dc356db824b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:56.711147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf26e8b-d5cd-49ac-b069-8dc356db824b admin admin] PATH_INFO: `/v3/projects/ffd350d0294a4b659409c7ab050c00a7/users/41f801c2671b49dabd74063b481dd5a2/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:56.716471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a0d36-1be1-47d4-9cea-cfb40a57721c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:56.718911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf26e8b-d5cd-49ac-b069-8dc356db824b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd350d0294a4b659409c7ab050c00a7, user_id=41f801c2671b49dabd74063b481dd5a2, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:56.729751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf26e8b-d5cd-49ac-b069-8dc356db824b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:56.758401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:56.759242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:56.759532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:56.769827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] PATH_INFO: `/v3/projects/ae859d73d56d49c9ab108ee67f2bedf1` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:56.771739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae859d73d56d49c9ab108ee67f2bedf1)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:56.774889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:56.828092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 864/1729] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:39:56 2022] PUT /identity/v3/projects/ffd350d0294a4b659409c7ab050c00a7/users/41f801c2671b49dabd74063b481dd5a2/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:56.833487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:56.834029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:56.834451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:56.910576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] MFA Rules not processed for user `41f801c2671b49dabd74063b481dd5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:56.911839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:57.033173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae859d73d56d49c9ab108ee67f2bedf1', 'request_id': 'req-4b9550a6-50c0-4d41-9c36-00914a008886'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.044486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae859d73d56d49c9ab108ee67f2bedf1', 'request_id': 'req-4b9550a6-50c0-4d41-9c36-00914a008886'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.052863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae859d73d56d49c9ab108ee67f2bedf1', 'request_id': 'req-4b9550a6-50c0-4d41-9c36-00914a008886'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.161491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:57.170194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] The token cache is being invalidate because project ae859d73d56d49c9ab108ee67f2bedf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:39:57.171492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.171940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 865/1730] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:39:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:39:57.173622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.179680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:57.190769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 866/1731] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:39:56 2022] DELETE /identity/v3/projects/ae859d73d56d49c9ab108ee67f2bedf1 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:57.208862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:57.220323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:57.484011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9550a6-50c0-4d41-9c36-00914a008886 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:57.487896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e6af-a158-4fa9-816c-f14f17d2196a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:57.506101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:57.506925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:57.507218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:57.507504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] PATH_INFO: `/v3/users/42c5e566530d4c50aca6aaac2a02f86c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:57.520708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c5e566530d4c50aca6aaac2a02f86c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:57.532586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:57.689762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:57.692543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:57.692833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:57.696259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:57.698310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:57.866914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c5e566530d4c50aca6aaac2a02f86c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.872289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c5e566530d4c50aca6aaac2a02f86c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.893520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c5e566530d4c50aca6aaac2a02f86c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.897394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:57.898891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:57.926656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c5e566530d4c50aca6aaac2a02f86c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.928005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fd24a683-7c35-4656-b40e-299d3cd0237b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c5e566530d4c50aca6aaac2a02f86c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:39:57.934877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 866/1732] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:58.042581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 867/1733] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:39:57 2022] DELETE /identity/v3/users/42c5e566530d4c50aca6aaac2a02f86c => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:39:58.251023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:58.258223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:58.267805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b342bf-02bf-4c2b-a29e-bf574c5e087b service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:58.283322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:58.288206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:58.288206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:58.400908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:39:58.402873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:58.617937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:58.638893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:58.650318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:58.657382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:58.657382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:58.671959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:58.779667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 868/1734] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:39:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:39:58.877758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:58.880086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:58.910523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 867/1735] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:39:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:39:59.367981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:39:59.370699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:39:59.695563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba530fa-779f-4f29-9672-14a4ee2f3dde None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:39:59.713229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28c9c2-6d32-4d5f-9e78-99997aed45ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:39:59.713993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c9c2-6d32-4d5f-9e78-99997aed45ca service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:39:59.714488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c9c2-6d32-4d5f-9e78-99997aed45ca service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:39:59.714774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c9c2-6d32-4d5f-9e78-99997aed45ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:39:59.728480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28c9c2-6d32-4d5f-9e78-99997aed45ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:39:59.736555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28c9c2-6d32-4d5f-9e78-99997aed45ca service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:39:59.752995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 869/1736] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:39:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:40:00.392115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:00.973000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:00.974806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:00.984356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:01.267953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce949a9-3598-43e3-abf4-daac552ced8d service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:01.291187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:01.293016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:01.293016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:01.293016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] PATH_INFO: `/v3/projects/9e728a1aabdf4f33ae98920cb8b45296` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:01.296950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e728a1aabdf4f33ae98920cb8b45296)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:01.299803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:01.673626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e728a1aabdf4f33ae98920cb8b45296', 'request_id': 'req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:01.744805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e728a1aabdf4f33ae98920cb8b45296', 'request_id': 'req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:01.790099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e728a1aabdf4f33ae98920cb8b45296', 'request_id': 'req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:01.902230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] The token cache is being invalidate because project 9e728a1aabdf4f33ae98920cb8b45296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:01.904146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:01.904597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9e8d3dce-5f69-40dd-928a-e85ba5f235f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:01.907861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 868/1737] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:00 2022] DELETE /identity/v3/projects/9e728a1aabdf4f33ae98920cb8b45296 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:01.914534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:01.915176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:01.916296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:01.968213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:01.974492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:02.258148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 870/1738] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:02.266232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:02.266519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:02.266975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:02.327588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:02.334501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:02.356757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 869/1739] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:02.361503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:02.378625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051287-5df1-4748-9b4f-6886f2b54230 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:02.406022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:02.409860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:02.410158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:02.410505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:02.411243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:02.429602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:02.432799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238df4c-bd35-413d-b0e8-2b67219ef297 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:02.568832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 871/1740] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:40:02.569671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:02.586907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ad61-6e8a-48a5-b2c6-247a3eabbc7d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:02.611669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:02.626076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:02.626771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:02.628515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:02.632276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:02.641769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:02.648306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:02.648306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:02.648306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:02.689608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] MFA Rules not processed for user `aefebccee9e74e91a48485fa6f074698`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:02.691352 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:02.907568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 870/1741] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:02 2022] POST /identity/v3/projects => generated 377 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:02.913550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:02.934050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 872/1742] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jul 27 08:40:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:03.060009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:03.064035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:03.083036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c103a6-98a2-466c-85ae-99bde4840b68 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:03.117288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:03.117954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.118231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.118571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.119256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:03.122436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:03.138526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62b70d-e7d1-4c0f-8dbd-21238d34390d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:03.270925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 871/1743] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:02 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:03.277829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:03.333751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3ce4-1fa1-489d-b786-6d6e180301ae admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:03.342498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:03.345299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.345761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.346195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.359351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:03.362706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:03.371272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:03.386512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.386512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.386512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.389326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:03.396586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 873/1744] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:03.398453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:03.458267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:03.485950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 872/1745] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:03.486536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:03.536622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e2574-40d1-4693-95b6-0b1b314c4b4c service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:03.567760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:03.568815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.576164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.576164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.576164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:03.576164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:03.579825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:03.582048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:03.620897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 874/1746] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:03.625966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:03.648429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ac47-770f-4865-800d-04ef7054b93e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:03.657205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3743f-a6af-46a6-919b-ff4bb49d0c79 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:03.671047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:03.673143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.673283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de65778-daf4-4b2f-9416-5a267694e98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:03.674025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de65778-daf4-4b2f-9416-5a267694e98f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.674188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de65778-daf4-4b2f-9416-5a267694e98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.674605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.677464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] PATH_INFO: `/v3/projects/861a693948e54e909663f35b3fbfa129/users/99f5e437e69642349fcc44e281a9b314/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.693973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de65778-daf4-4b2f-9416-5a267694e98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.738755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861a693948e54e909663f35b3fbfa129, user_id=99f5e437e69642349fcc44e281a9b314, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:03.748643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de65778-daf4-4b2f-9416-5a267694e98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:03.753787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:03.759161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de65778-daf4-4b2f-9416-5a267694e98f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:03.786030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 873/1747] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:03.869950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 875/1748] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:03 2022] PUT /identity/v3/projects/861a693948e54e909663f35b3fbfa129/users/99f5e437e69642349fcc44e281a9b314/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:03.887252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:03.888072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:03.888539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:03.976093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:03.990024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] MFA Rules not processed for user `99f5e437e69642349fcc44e281a9b314`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:03.991277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:04.208539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 874/1749] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:04.209184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:04.389288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010aa0-8253-4d0c-8cf6-445e6f7b82c1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:04.406827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:04.407469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:04.409151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:04.409693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:04.410763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:04.415884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:04.557982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 876/1750] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:04 2022] POST /identity/v3/projects => generated 375 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:04.562180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:04.585906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff078647-3f47-4be1-ad4e-d9d7ce7c597d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:04.731535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:04.733412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:04.734718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:04.736205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:04.737227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:04.743250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:04.876780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:04.884237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 875/1751] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:04 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:04.889329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:04.917441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ff148-6427-4a15-8683-40f5a18cb6b0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:04.929964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:04.930750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:04.931205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:04.931575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:04.932462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:04.935473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:04.973793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 877/1752] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:04.978158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:04.992523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2785b5f-5e00-4ad9-9a67-0f57843722b9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:05.006148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:05.007839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:05.009262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:05.009716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] PATH_INFO: `/v3/projects/c26d365d3cb14f1eacc58b21b9d467a1/users/0a4c257f81904f6480b69a5ce72e9416/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:05.052301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26d365d3cb14f1eacc58b21b9d467a1, user_id=0a4c257f81904f6480b69a5ce72e9416, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:05.055705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:05.181110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 876/1753] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:04 2022] PUT /identity/v3/projects/c26d365d3cb14f1eacc58b21b9d467a1/users/0a4c257f81904f6480b69a5ce72e9416/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:05.185879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:05.199516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9c33-d4d4-4126-a91d-c31585e7fee2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:05.382230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709a10-b7a1-493f-9900-a264fb7e31d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:05.384539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709a10-b7a1-493f-9900-a264fb7e31d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:05.384957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709a10-b7a1-493f-9900-a264fb7e31d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:05.385416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709a10-b7a1-493f-9900-a264fb7e31d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:05.388630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51709a10-b7a1-493f-9900-a264fb7e31d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:05.394449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51709a10-b7a1-493f-9900-a264fb7e31d5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:05.422666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 878/1754] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:05.426118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:05.444826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457d9c-7428-47c9-9b63-b3c0ad5012a2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:05.459535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:05.460903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:05.461298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:05.461748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] PATH_INFO: `/v3/projects/c26d365d3cb14f1eacc58b21b9d467a1/users/0a4c257f81904f6480b69a5ce72e9416/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:05.465294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26d365d3cb14f1eacc58b21b9d467a1, user_id=0a4c257f81904f6480b69a5ce72e9416, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:05.470655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:05.487406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 877/1755] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:05 2022] PUT /identity/v3/projects/c26d365d3cb14f1eacc58b21b9d467a1/users/0a4c257f81904f6480b69a5ce72e9416/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:05.507796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:05.508296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:05.519931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:05.653483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] MFA Rules not processed for user `0a4c257f81904f6480b69a5ce72e9416`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:05.656012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:05.813945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 879/1756] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:05.825665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:05.828825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:05.983719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:06.055548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f90a0-33de-4509-91ee-cb165d4d92fc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:06.071684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4390a-30b2-476c-90d5-aefdc5b5c651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:06.072485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4390a-30b2-476c-90d5-aefdc5b5c651 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:06.072795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4390a-30b2-476c-90d5-aefdc5b5c651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:06.074585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4390a-30b2-476c-90d5-aefdc5b5c651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:06.187066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4390a-30b2-476c-90d5-aefdc5b5c651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:06.192549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4390a-30b2-476c-90d5-aefdc5b5c651 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:06.210012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 878/1757] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:06.456904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:06.517888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:07.319503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:07.450804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:08.143028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:08.697444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:08.856345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:08.870504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777ca8e-7240-471c-aca8-1da61d2a29dd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:08.877090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30be0ce-2671-4670-8c6a-20fe4fea765d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:08.879403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30be0ce-2671-4670-8c6a-20fe4fea765d service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:08.881290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30be0ce-2671-4670-8c6a-20fe4fea765d service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:08.881786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30be0ce-2671-4670-8c6a-20fe4fea765d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:08.920987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30be0ce-2671-4670-8c6a-20fe4fea765d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:08.925201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30be0ce-2671-4670-8c6a-20fe4fea765d service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:08.970011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 880/1758] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:09.053537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec399-e9c0-4c21-afb8-982841437f3c None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:09.054132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec399-e9c0-4c21-afb8-982841437f3c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:09.054756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ec399-e9c0-4c21-afb8-982841437f3c None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:09.056654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 879/1759] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:40:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:40:09.146462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257364ae-5d4a-49b1-ab9b-5a14c1f588cb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:09.164824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257364ae-5d4a-49b1-ab9b-5a14c1f588cb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:09.167196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257364ae-5d4a-49b1-ab9b-5a14c1f588cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:09.196066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-257364ae-5d4a-49b1-ab9b-5a14c1f588cb None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:09.196219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-257364ae-5d4a-49b1-ab9b-5a14c1f588cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:09.397987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 881/1760] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:10.325656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ec399-e9c0-4c21-afb8-982841437f3c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:10.328112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c43ec399-e9c0-4c21-afb8-982841437f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:10.364382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ec399-e9c0-4c21-afb8-982841437f3c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:10.427898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbf4fe-7d13-4e45-80bb-7a6704ef9875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:10.428913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbf4fe-7d13-4e45-80bb-7a6704ef9875 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:10.429208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbf4fe-7d13-4e45-80bb-7a6704ef9875 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:10.436760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbf4fe-7d13-4e45-80bb-7a6704ef9875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:10.449590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbf4fe-7d13-4e45-80bb-7a6704ef9875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:10.456500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbf4fe-7d13-4e45-80bb-7a6704ef9875 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:10.499829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 880/1761] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:10.953642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfc177-335f-45ac-a279-7b76cca6a13f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:10.955194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfc177-335f-45ac-a279-7b76cca6a13f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:10.955672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfc177-335f-45ac-a279-7b76cca6a13f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:10.958405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 882/1762] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:40:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:40:11.010855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:11.011141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:11.011860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:11.087868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:11.094242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:11.123149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 881/1763] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:40:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:11.415278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfc177-335f-45ac-a279-7b76cca6a13f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:11.417555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-74bfc177-335f-45ac-a279-7b76cca6a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:11.597367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfc177-335f-45ac-a279-7b76cca6a13f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:11.611757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:11.613860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:11.614191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:11.614755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] PATH_INFO: `/v3/users/b45a666cee1942bd848a70cb57f4d7c0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:11.620027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45a666cee1942bd848a70cb57f4d7c0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:11.622308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:11.702622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:11.757088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:11.762885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:11.794052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e063eb-cc6d-40e2-accc-fa6bed603a5e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:11.810050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9c7a4-6a97-4b83-8c98-944aad90c50b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:11.811052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9c7a4-6a97-4b83-8c98-944aad90c50b service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:11.811481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9c7a4-6a97-4b83-8c98-944aad90c50b service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:11.811934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9c7a4-6a97-4b83-8c98-944aad90c50b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:11.843757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9c7a4-6a97-4b83-8c98-944aad90c50b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:11.845654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9c7a4-6a97-4b83-8c98-944aad90c50b service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:11.890736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 882/1764] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:12.001476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45a666cee1942bd848a70cb57f4d7c0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:12.007873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45a666cee1942bd848a70cb57f4d7c0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:12.035451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45a666cee1942bd848a70cb57f4d7c0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:12.049057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:12.068914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45a666cee1942bd848a70cb57f4d7c0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:12.070462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45a666cee1942bd848a70cb57f4d7c0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:12.162223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 883/1765] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:11 2022] DELETE /identity/v3/users/b45a666cee1942bd848a70cb57f4d7c0 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:12.165349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:12.165642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:12.165912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:12.202644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:12.204318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:12.350508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 883/1766] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:12.391742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:12.393574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:12.523996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3a8fb-1019-443b-aaab-bcecbec10b5d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:12.531608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4028b-563d-4092-a647-02ef880f5a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:12.532496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4028b-563d-4092-a647-02ef880f5a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:12.532955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4028b-563d-4092-a647-02ef880f5a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:12.533373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4028b-563d-4092-a647-02ef880f5a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:12.555960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4028b-563d-4092-a647-02ef880f5a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:12.557555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4028b-563d-4092-a647-02ef880f5a4d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:12.587132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 884/1767] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:14.953239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:14.955956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:14.971074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bd651-efda-44e5-a927-3f26e137ed56 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:14.988988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:14.988988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:14.988988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:14.988988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] PATH_INFO: `/v3/users/99f5e437e69642349fcc44e281a9b314` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:14.989649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f5e437e69642349fcc44e281a9b314)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:14.989649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:15.308713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f5e437e69642349fcc44e281a9b314'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.402136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f5e437e69642349fcc44e281a9b314'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.412151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f5e437e69642349fcc44e281a9b314'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.414504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f5e437e69642349fcc44e281a9b314'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.414504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f5e437e69642349fcc44e281a9b314'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.433868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 884/1768] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:14 2022] DELETE /identity/v3/users/99f5e437e69642349fcc44e281a9b314 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:15.439265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:15.443190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:15.443190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:15.462379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:15.466163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:15.538342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 885/1769] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:15.549235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:15.550746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:15.583556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:15.585874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:15.602896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:15.608255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46713a6a-721c-4012-ac40-211592f75e84 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:15.614800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:15.615538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:15.616134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:15.616575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] PATH_INFO: `/v3/projects/5997d576be824efcbca65a74c905a4b6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:15.617943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5997d576be824efcbca65a74c905a4b6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:15.619855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:15.620997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab2a9-8988-47cf-9e7a-200cdafa8d7b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:15.625106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:15.631572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:15.631572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:15.631572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:15.638662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:15.640461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:15.653106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 885/1770] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:15.757020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:15.773300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5997d576be824efcbca65a74c905a4b6', 'request_id': 'req-cd94e278-5265-4063-b978-79539ab0e9ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.776337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5997d576be824efcbca65a74c905a4b6', 'request_id': 'req-cd94e278-5265-4063-b978-79539ab0e9ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.783656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5997d576be824efcbca65a74c905a4b6', 'request_id': 'req-cd94e278-5265-4063-b978-79539ab0e9ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.901410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] The token cache is being invalidate because project 5997d576be824efcbca65a74c905a4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:15.901713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.902447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:15.904668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 886/1771] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:15 2022] DELETE /identity/v3/projects/5997d576be824efcbca65a74c905a4b6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:15.909728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:15.920476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3a6d-84f8-41d4-b10e-d6ea7b0e1868 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:15.981262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:15.981929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:15.982463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:15.983337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] PATH_INFO: `/v3/users/41f801c2671b49dabd74063b481dd5a2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:15.985704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f801c2671b49dabd74063b481dd5a2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:15.987655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:16.177135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:16.178553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:16.212600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e278-5265-4063-b978-79539ab0e9ce admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:16.219006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f801c2671b49dabd74063b481dd5a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.219871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:16.220717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:16.221148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:16.221523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] PATH_INFO: `/v3/projects/861a693948e54e909663f35b3fbfa129` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:16.223180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861a693948e54e909663f35b3fbfa129)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:16.225711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:16.300718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f801c2671b49dabd74063b481dd5a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.305478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f801c2671b49dabd74063b481dd5a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.306815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f801c2671b49dabd74063b481dd5a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.306815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f801c2671b49dabd74063b481dd5a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.335127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 886/1772] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:15 2022] DELETE /identity/v3/users/41f801c2671b49dabd74063b481dd5a2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:16.413332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861a693948e54e909663f35b3fbfa129', 'request_id': 'req-a5f80682-e071-48de-b17f-78be798f8350'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.425444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861a693948e54e909663f35b3fbfa129', 'request_id': 'req-a5f80682-e071-48de-b17f-78be798f8350'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.432860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861a693948e54e909663f35b3fbfa129', 'request_id': 'req-a5f80682-e071-48de-b17f-78be798f8350'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.535909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] The token cache is being invalidate because project 861a693948e54e909663f35b3fbfa129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:16.536515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.536877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.539826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 887/1773] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:16 2022] DELETE /identity/v3/projects/861a693948e54e909663f35b3fbfa129 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:16.542751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:16.544371 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:16.609682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dbc0c-11a3-4e6c-8a02-7264debd5998 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:16.673368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:16.673368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:16.673761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:16.674133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] PATH_INFO: `/v3/users/0a4c257f81904f6480b69a5ce72e9416` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:16.675489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4c257f81904f6480b69a5ce72e9416)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:16.677881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:16.869773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4c257f81904f6480b69a5ce72e9416'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.912671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:16.914088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:16.930056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80682-e071-48de-b17f-78be798f8350 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:16.935065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:16.935800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:16.936106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:16.936386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] PATH_INFO: `/v3/projects/ffd350d0294a4b659409c7ab050c00a7` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:16.937646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd350d0294a4b659409c7ab050c00a7)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:16.939793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:16.970160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4c257f81904f6480b69a5ce72e9416'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.978431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4c257f81904f6480b69a5ce72e9416'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.979112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4c257f81904f6480b69a5ce72e9416'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.979723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fd914823-e296-4ffc-95ad-e2f68fa60443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4c257f81904f6480b69a5ce72e9416'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:16.997376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 887/1774] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:16 2022] DELETE /identity/v3/users/0a4c257f81904f6480b69a5ce72e9416 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:17.038553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd350d0294a4b659409c7ab050c00a7', 'request_id': 'req-a05a52a5-32c4-47fc-b438-827ae8f14acf'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.045669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd350d0294a4b659409c7ab050c00a7', 'request_id': 'req-a05a52a5-32c4-47fc-b438-827ae8f14acf'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.052065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd350d0294a4b659409c7ab050c00a7', 'request_id': 'req-a05a52a5-32c4-47fc-b438-827ae8f14acf'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.135265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] The token cache is being invalidate because project ffd350d0294a4b659409c7ab050c00a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:17.135560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.139174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a05a52a5-32c4-47fc-b438-827ae8f14acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.139174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 888/1775] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:16 2022] DELETE /identity/v3/projects/ffd350d0294a4b659409c7ab050c00a7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:17.143626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.143924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.144202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.163534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:17.167757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:17.223935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 888/1776] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:17.238345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.238631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.238931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.260223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:17.261526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:17.269775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 889/1777] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:17.274518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.289252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4580174-7a55-4f53-a023-7455fe5ef57c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.293808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.294331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.294611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.294912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.295628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:17.296442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.298250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.310639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 889/1778] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:17.315523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.325258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc2741-17d6-41f0-80f3-655aefd9b590 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.330465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.331092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.331398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.331674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.332370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.334527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.434941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 890/1779] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:17.440007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.450489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859d8e7-b6ce-4620-8a8d-bd0b21ea5bd8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.519746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:17.520794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.521955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.522538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.522752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.523425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.525408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.552886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.554669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:17.570279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277a74-ed5b-4984-978b-375b18996290 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.579295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.579295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.579295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.579295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] PATH_INFO: `/v3/projects/c26d365d3cb14f1eacc58b21b9d467a1` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.579974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26d365d3cb14f1eacc58b21b9d467a1)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.580706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.605949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 890/1780] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:17.614488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.622409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:DELETE=19,keystone:SELECT=77,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:17.626356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da4f7a-71eb-4e80-a850-51ca4ad8efc9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.631538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.632221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.632612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.633019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.633822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.635523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.647749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 891/1781] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:17.651630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.666102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929517b-776d-44be-9332-7e6194a983ff admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.674451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.675085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.675375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.675654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.676340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.678009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.697204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 892/1782] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:17.701743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:17.711788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26d365d3cb14f1eacc58b21b9d467a1', 'request_id': 'req-2f06f0e1-22b3-4315-92a2-ba73a407f71f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.715471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa9573-5d24-4561-afa4-19d2fbdfe5f9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:17.720022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26d365d3cb14f1eacc58b21b9d467a1', 'request_id': 'req-2f06f0e1-22b3-4315-92a2-ba73a407f71f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.727881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26d365d3cb14f1eacc58b21b9d467a1', 'request_id': 'req-2f06f0e1-22b3-4315-92a2-ba73a407f71f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.790866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9334cb-7b11-499c-961e-04924e42fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:17.791545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9334cb-7b11-499c-961e-04924e42fde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.791831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9334cb-7b11-499c-961e-04924e42fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.792107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9334cb-7b11-499c-961e-04924e42fde1 admin admin] PATH_INFO: `/v3/projects/9d8405d57d91493e9a416140dd41712f/users/d6f08b60ceb844409a6710f6595d4d0f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.808621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9334cb-7b11-499c-961e-04924e42fde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8405d57d91493e9a416140dd41712f, user_id=d6f08b60ceb844409a6710f6595d4d0f, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:17.811431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9334cb-7b11-499c-961e-04924e42fde1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:17.845713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] The token cache is being invalidate because project c26d365d3cb14f1eacc58b21b9d467a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:17.846024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.846751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2f06f0e1-22b3-4315-92a2-ba73a407f71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:17.848485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 891/1783] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:17 2022] DELETE /identity/v3/projects/c26d365d3cb14f1eacc58b21b9d467a1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:17.853653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac46c5-e634-4d88-9190-29d7adad61da None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.853940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac46c5-e634-4d88-9190-29d7adad61da None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.854219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac46c5-e634-4d88-9190-29d7adad61da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.873955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-47ac46c5-e634-4d88-9190-29d7adad61da None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:17.875823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-47ac46c5-e634-4d88-9190-29d7adad61da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:17.884008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 892/1784] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:17.892238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.892523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.892833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.912500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:17.913742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:17.918595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 893/1785] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:17 2022] PUT /identity/v3/projects/9d8405d57d91493e9a416140dd41712f/users/d6f08b60ceb844409a6710f6595d4d0f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:17.929228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:17.929655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:17.930109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:17.964603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] MFA Rules not processed for user `d6f08b60ceb844409a6710f6595d4d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:17.965897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:17.983266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 893/1786] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:17.993718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.003521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e6f0-08a1-4183-b748-a343b9a86a0f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.013826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.013826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.013826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.013826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.014135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:18.014135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.014135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.026628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 894/1787] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:18.031373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.044883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 894/1788] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:18.046552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba13b9-75e8-44a9-81a7-a1f764b89671 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.050018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.051110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.051423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:18.051737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.052027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.052305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.053018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.054966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.068866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9406977-0bbe-482f-80f0-89edc38e6ee4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.074323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.075002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.075279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.075555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.076217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.078768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.149181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 895/1789] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:18.151321 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.164672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 895/1790] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:18.168814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.229385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2993c6-e4bd-438f-81fb-fd9dcdd22895 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.234653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.235283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.235567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.235849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.236519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.238500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.238622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4974206-a594-46d6-aa6c-86acacc8100e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.243510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.244328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.244619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.244930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.245634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.247703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.341698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 896/1791] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:18.345344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.348543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 896/1792] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:18.348543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.362566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eac99-8a98-49de-805c-c971b8501eb5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.370385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.370584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99155-47da-4f55-a72d-33d29287081e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.371022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.371899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.372238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.373853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.376033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.378030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.378030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.378030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.378030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.378672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.380395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.390759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 897/1793] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:18.392508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 897/1794] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:18.394868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.397494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.409450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373183bb-888b-45a0-a1fd-7f1a3bb117dd admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.413475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648590d-a32c-4929-b850-8870f716caae admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.414880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.415557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.415850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.416122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] PATH_INFO: `/v3/projects/e99af7fe0a96425ea4efc083f624a6bd/users/b67cb21ac18248e0a502ae5e34699028/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.420485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.422271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.422767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.423265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.424523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.426823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.440420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99af7fe0a96425ea4efc083f624a6bd, user_id=b67cb21ac18248e0a502ae5e34699028, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.440825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 898/1795] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:18.442648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.448968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.459166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c5dfc-d302-4339-9b8e-e3a52d54ad8c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.464689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea04eb-d548-45c0-837f-ed0495b300c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.465562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea04eb-d548-45c0-837f-ed0495b300c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.465916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea04eb-d548-45c0-837f-ed0495b300c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.466444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea04eb-d548-45c0-837f-ed0495b300c8 admin admin] PATH_INFO: `/v3/projects/5bfc35dab261404bb44cc5faf694eeb4/users/91922a5d4cf94cef8ceff4a2b540e4a1/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.486503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea04eb-d548-45c0-837f-ed0495b300c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfc35dab261404bb44cc5faf694eeb4, user_id=91922a5d4cf94cef8ceff4a2b540e4a1, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.489518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea04eb-d548-45c0-837f-ed0495b300c8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.524113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 898/1796] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:18 2022] PUT /identity/v3/projects/e99af7fe0a96425ea4efc083f624a6bd/users/b67cb21ac18248e0a502ae5e34699028/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:18.527739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.575056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 899/1797] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:18 2022] PUT /identity/v3/projects/5bfc35dab261404bb44cc5faf694eeb4/users/91922a5d4cf94cef8ceff4a2b540e4a1/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:18.576594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.576906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.577253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.613559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1083a9c-3203-482c-8781-86eb207cccca admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.614274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] MFA Rules not processed for user `91922a5d4cf94cef8ceff4a2b540e4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:18.617421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:18.620352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:18.683697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.684465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.684661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.684948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.685649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.687367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.697103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 900/1798] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:18.701903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.703366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 899/1799] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:18.707082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.722142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df773e8e-2066-4ecf-bbf6-a9de4d2a9abd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.724170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:18.727821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.728704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.729035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.729354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.730024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.732863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.742695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809d0e4-1c1a-4a02-97c3-47fe7f17762b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.749990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfaa98-4746-4001-a382-2c6c40eec9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.750841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfaa98-4746-4001-a382-2c6c40eec9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.751220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfaa98-4746-4001-a382-2c6c40eec9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.751887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfaa98-4746-4001-a382-2c6c40eec9d5 admin admin] PATH_INFO: `/v3/projects/e99af7fe0a96425ea4efc083f624a6bd/users/b67cb21ac18248e0a502ae5e34699028/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.754113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfaa98-4746-4001-a382-2c6c40eec9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99af7fe0a96425ea4efc083f624a6bd, user_id=b67cb21ac18248e0a502ae5e34699028, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.756979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfaa98-4746-4001-a382-2c6c40eec9d5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:18.768594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 900/1800] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:18 2022] PUT /identity/v3/projects/e99af7fe0a96425ea4efc083f624a6bd/users/b67cb21ac18248e0a502ae5e34699028/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:18.781341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.781816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.782165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.820873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] MFA Rules not processed for user `b67cb21ac18248e0a502ae5e34699028`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:18.822228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:18.860000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 901/1801] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:18.862682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.931798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 901/1802] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:18.944190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:18.945607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:18.950670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ad30f-f26e-49d1-aac1-926c280ef76e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:18.969189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:18.969825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:18.970110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:18.970382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:18.971217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:18.973448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.010298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bec8-c151-44b9-a710-2542a3ab1674 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.063210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.064467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.064903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.065293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.072812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 902/1803] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:18 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:19.074093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:19.086789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7fac1-0615-4d0a-8a59-8656ff3986fe admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.093445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.094345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.094808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.095718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.096589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.099259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.118985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 903/1804] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:19.120053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:19.133589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4354e-f6d3-4001-82d1-50fba37859f9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.144098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.144938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.145233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.145508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.146699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.149929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.151068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.152034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.165185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 902/1805] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:19.175832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 904/1806] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:19.177411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:19.215992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2bb4-b3d0-43d3-87f3-9659937242eb service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.225195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aeee5-6ac0-4710-972e-d3ddd010ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.226082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aeee5-6ac0-4710-972e-d3ddd010ebdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.226564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aeee5-6ac0-4710-972e-d3ddd010ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.226985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aeee5-6ac0-4710-972e-d3ddd010ebdd admin admin] PATH_INFO: `/v3/projects/e5403181105344678821f7a64eae858f/users/87ce5838e9c643c3ac96402f6b912ab8/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.273406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aeee5-6ac0-4710-972e-d3ddd010ebdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5403181105344678821f7a64eae858f, user_id=87ce5838e9c643c3ac96402f6b912ab8, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.276556 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aeee5-6ac0-4710-972e-d3ddd010ebdd admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.298383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:19.310170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579bc31-684f-4716-8b18-7569314cffe2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.315548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.316246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.316594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.316965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.357243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 903/1807] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:19 2022] PUT /identity/v3/projects/e5403181105344678821f7a64eae858f/users/87ce5838e9c643c3ac96402f6b912ab8/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:19.367892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.368226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.368633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.408712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] MFA Rules not processed for user `87ce5838e9c643c3ac96402f6b912ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:19.409458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.416304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:19.416428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.427761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 905/1808] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:19.542580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 904/1809] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:19.543726 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:19.560878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d349b-1ec5-4962-aede-eebcee58c3f1 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.638818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.639677 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.640273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.640654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.641471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.643476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:19.749727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 906/1810] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:19 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:19.753754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:19.766131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0297ba2-440e-46aa-a702-aa5a608a181c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:19.831924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:19.833635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:19.833635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:19.833635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:19.835565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:19.837675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:20.668278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 905/1811] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:19 2022] POST /identity/v3/users => generated 299 bytes in 892 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:20.669098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:20.679938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f483c-2ef4-4769-8f4f-e64c8876accf admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:20.685695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:20.686982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:20.687712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:20.687712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:20.688320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:20.689983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:20.706731 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:20.707454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 907/1812] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:20.721600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcb4e6-ea54-4f95-882c-218d789ff174 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:20.727555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa89c12-cde1-48c3-8cae-7b6523c43482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:20.728698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa89c12-cde1-48c3-8cae-7b6523c43482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:20.729219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa89c12-cde1-48c3-8cae-7b6523c43482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:20.729695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa89c12-cde1-48c3-8cae-7b6523c43482 admin admin] PATH_INFO: `/v3/projects/229b6ab9a59248f7ade496c813e59276/users/713e221d783d456fa108067e7239057a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:20.745791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa89c12-cde1-48c3-8cae-7b6523c43482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229b6ab9a59248f7ade496c813e59276, user_id=713e221d783d456fa108067e7239057a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:20.748453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa89c12-cde1-48c3-8cae-7b6523c43482 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:20.785878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:20.888555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:20.899727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 906/1813] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:20 2022] PUT /identity/v3/projects/229b6ab9a59248f7ade496c813e59276/users/713e221d783d456fa108067e7239057a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:20.904165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:20.923032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368491f8-022c-4ec1-8b8f-2db0eecb3839 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:20.951598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18081c9-2208-48db-b445-a2dc591aa4a7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:20.953268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18081c9-2208-48db-b445-a2dc591aa4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:20.954106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18081c9-2208-48db-b445-a2dc591aa4a7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:20.959049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 907/1814] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:40:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:40:21.023884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.024165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.024617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.058150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:21.058931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.059544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.060578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.062744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:21.066420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:21.082912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:21.084162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:21.086806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 908/1815] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:21.087769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:21.103349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfb855-ad3f-46b5-9e0f-14b296b08825 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:21.112116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b56a7-0ca9-4525-81d5-2e3d15969d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:21.112967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b56a7-0ca9-4525-81d5-2e3d15969d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.113355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b56a7-0ca9-4525-81d5-2e3d15969d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.113769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b56a7-0ca9-4525-81d5-2e3d15969d7a admin admin] PATH_INFO: `/v3/projects/229b6ab9a59248f7ade496c813e59276/users/713e221d783d456fa108067e7239057a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.115978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b56a7-0ca9-4525-81d5-2e3d15969d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=229b6ab9a59248f7ade496c813e59276, user_id=713e221d783d456fa108067e7239057a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:21.119105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b56a7-0ca9-4525-81d5-2e3d15969d7a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:21.140585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 909/1816] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:21 2022] PUT /identity/v3/projects/229b6ab9a59248f7ade496c813e59276/users/713e221d783d456fa108067e7239057a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:21.155408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.157049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.157357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.227505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] MFA Rules not processed for user `713e221d783d456fa108067e7239057a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:21.228409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 908/1817] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:40:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:21.229465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:21.383213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:21.384668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:21.393846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 910/1818] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:21.406814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:21.418925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136b65d-7de7-42d0-8230-e62060749e43 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:21.489534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339ab2b-1bdb-4d42-88a2-0b74fa1c8c5d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:21.494014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:21.494822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.495293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.495794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.506552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:21.508923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:21.531173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 911/1819] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:21.533631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:21.535246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:21.535691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:21.536660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.537216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.537637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] PATH_INFO: `/v3/users/2fc1cd6bf5fa4ec786814d3e48a7d1ba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.539037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc1cd6bf5fa4ec786814d3e48a7d1ba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:21.541648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:21.673631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb1db2-9675-475b-8f89-0ced9f902537 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:21.701776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123288b-b517-41e1-a3da-15e35eeb29d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:21.701776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123288b-b517-41e1-a3da-15e35eeb29d9 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.701776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123288b-b517-41e1-a3da-15e35eeb29d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.701776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123288b-b517-41e1-a3da-15e35eeb29d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.710251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123288b-b517-41e1-a3da-15e35eeb29d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:21.711922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123288b-b517-41e1-a3da-15e35eeb29d9 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:21.730036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 912/1820] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:21.849318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc1cd6bf5fa4ec786814d3e48a7d1ba'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:21.850302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc1cd6bf5fa4ec786814d3e48a7d1ba'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:21.859342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc1cd6bf5fa4ec786814d3e48a7d1ba'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:21.873558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc1cd6bf5fa4ec786814d3e48a7d1ba'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:21.874572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc1cd6bf5fa4ec786814d3e48a7d1ba'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:21.935129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 909/1821] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:21 2022] DELETE /identity/v3/users/2fc1cd6bf5fa4ec786814d3e48a7d1ba => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:21.940610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:21.941069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:21.941410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:21.964342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:21.965739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:22.078680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 913/1822] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:22.090381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:22.092004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:22.162664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa4910-7edb-4a90-9c5d-0cded7b3120b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:22.166456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:22.167106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:22.167387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:22.167660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:22.179203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:22.179719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:22.189700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 910/1823] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:22.238740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:22.321797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:22.729064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:22.730531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:22.746792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4c776-41d5-48b5-9139-1d1e5812a94d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:22.762678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:22.763686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:22.764112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:22.765108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] PATH_INFO: `/v3/projects/ac35c6b05b2a4b35a8ecb4c78d5f1198` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:22.766872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac35c6b05b2a4b35a8ecb4c78d5f1198)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:22.770834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:22.876197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:22.878021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:22.976111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac35c6b05b2a4b35a8ecb4c78d5f1198', 'request_id': 'req-80011508-02ae-430f-ba78-9eebc2eaee13'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:22.979279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68affee2-355b-4f2d-9843-b069f1a94730 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:22.995422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac35c6b05b2a4b35a8ecb4c78d5f1198', 'request_id': 'req-80011508-02ae-430f-ba78-9eebc2eaee13'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.012133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac35c6b05b2a4b35a8ecb4c78d5f1198', 'request_id': 'req-80011508-02ae-430f-ba78-9eebc2eaee13'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.072046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:23.077265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:23.077265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:23.077265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:23.077265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:23.161012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:23.163343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:23.167222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] The token cache is being invalidate because project ac35c6b05b2a4b35a8ecb4c78d5f1198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:23.167459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.168674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.172440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 914/1824] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:22 2022] DELETE /identity/v3/projects/ac35c6b05b2a4b35a8ecb4c78d5f1198 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:23.176228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:23.180048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:23.184305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 911/1825] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:23.286675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011508-02ae-430f-ba78-9eebc2eaee13 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:23.292599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:23.293618 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:23.294849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:23.295382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] PATH_INFO: `/v3/users/22761ac999e943c2a11cda89a18095f9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:23.297697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22761ac999e943c2a11cda89a18095f9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:23.301061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:23.462918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:23.503154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:23.504571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:23.519232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0b84-b2b4-42b9-a22e-f823f3d9dbe2 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:23.525650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:23.528766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:23.528766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:23.528766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] PATH_INFO: `/v3/users/d6f08b60ceb844409a6710f6595d4d0f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:23.528766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f08b60ceb844409a6710f6595d4d0f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:23.530717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:23.538305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22761ac999e943c2a11cda89a18095f9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.604825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22761ac999e943c2a11cda89a18095f9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.614095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22761ac999e943c2a11cda89a18095f9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.614873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22761ac999e943c2a11cda89a18095f9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.615493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d6e57e8c-6fb9-4671-aded-251cd41c2c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22761ac999e943c2a11cda89a18095f9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.635926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 915/1826] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:23 2022] DELETE /identity/v3/users/22761ac999e943c2a11cda89a18095f9 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:23.750338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f08b60ceb844409a6710f6595d4d0f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.751029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f08b60ceb844409a6710f6595d4d0f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.758070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f08b60ceb844409a6710f6595d4d0f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.771241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f08b60ceb844409a6710f6595d4d0f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.771971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f08b60ceb844409a6710f6595d4d0f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:23.859397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 912/1827] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:23 2022] DELETE /identity/v3/users/d6f08b60ceb844409a6710f6595d4d0f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:23.864092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:23.864593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:23.864593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:23.885977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:23.887229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:23.969856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 916/1828] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:23.988477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:23.990641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:24.098902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c351d-a5ea-49b1-a8db-c39610e284a1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:24.110807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef2ac-b001-4ead-b5c6-e8e989923589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:24.111491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef2ac-b001-4ead-b5c6-e8e989923589 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.111755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef2ac-b001-4ead-b5c6-e8e989923589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.112337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef2ac-b001-4ead-b5c6-e8e989923589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.124857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ef2ac-b001-4ead-b5c6-e8e989923589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:24.127446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ef2ac-b001-4ead-b5c6-e8e989923589 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:24.138976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 913/1829] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:24.267208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:24.304217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:24.305867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:24.318584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c0eaa-400a-4745-9599-57076e3d1fac None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:24.323619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:24.324314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.324591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.324893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] PATH_INFO: `/v3/projects/110fe825687f4741b2be2b3e43744b53` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.326120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=110fe825687f4741b2be2b3e43744b53)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:24.328924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:24.432504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110fe825687f4741b2be2b3e43744b53', 'request_id': 'req-7886c2c9-c686-4d62-a02d-55d2764a20e9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:24.439246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110fe825687f4741b2be2b3e43744b53', 'request_id': 'req-7886c2c9-c686-4d62-a02d-55d2764a20e9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:24.445545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110fe825687f4741b2be2b3e43744b53', 'request_id': 'req-7886c2c9-c686-4d62-a02d-55d2764a20e9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:24.558986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] The token cache is being invalidate because project 110fe825687f4741b2be2b3e43744b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:24.559277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:24.559913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7886c2c9-c686-4d62-a02d-55d2764a20e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:24.561724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 917/1830] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:24 2022] DELETE /identity/v3/projects/110fe825687f4741b2be2b3e43744b53 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:24.566744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.567098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.567381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.624918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:24.629037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:24.726554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 914/1831] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:24.736063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.736381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.736783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.758864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:24.760616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:24.770047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 918/1832] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:24.774167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:24.783865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a69911-317c-4bb7-bbb8-67f2dc020117 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:24.789135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:24.789763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.790048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.790330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.791147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:24.791464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:24.793107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:24.812434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:24.816645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 915/1833] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:40:24.829817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540a1a-dcdf-4fde-bc11-032e817b2ec8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:24.829817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:24.829817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.829817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.830394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.831765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:24.833528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:24.835263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:24.840835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:24.857986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1e704-1064-4ab8-b7d2-cb2f8c4b02c9 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:24.859879 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:24.860542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:24.860946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:24.861240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] PATH_INFO: `/v3/projects/9d8405d57d91493e9a416140dd41712f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:24.862502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8405d57d91493e9a416140dd41712f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:24.864797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:24.963797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 919/1834] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:24 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:24.968220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.008397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8405d57d91493e9a416140dd41712f', 'request_id': 'req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.017620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8405d57d91493e9a416140dd41712f', 'request_id': 'req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.023662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8405d57d91493e9a416140dd41712f', 'request_id': 'req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.035294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10839c-0a98-4ac2-8f4b-9efe2f422992 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:25.105421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:25.106061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.106346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.106624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.107294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:25.109284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:25.125894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] The token cache is being invalidate because project 9d8405d57d91493e9a416140dd41712f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:25.126185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.127713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.129527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 916/1835] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:24 2022] DELETE /identity/v3/projects/9d8405d57d91493e9a416140dd41712f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:25.136845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.139311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:25.158303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0565a9-6ea7-4a79-a354-25b8ed3a53b0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:25.163415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:25.164295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.164653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.165096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] PATH_INFO: `/v3/users/b67cb21ac18248e0a502ae5e34699028` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.166418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67cb21ac18248e0a502ae5e34699028)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:25.168536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:25.233302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:25.239679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 920/1836] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:24 2022] POST /identity/v3/users => generated 284 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:25.244969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.246590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:25.260884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7bce-c1ec-410d-bce2-fa0313411751 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:25.292419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:25.293102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.294536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.294837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.297123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:25.304012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:25.321153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 921/1837] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:25.325899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.337129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96330a4-7360-4b0b-8170-1d8a9f8834a6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:25.341939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:25.343246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.343246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.343246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.343862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:25.345503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:25.356772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 922/1838] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:25.361057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.371071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bee40-7cc5-4381-9a52-cb91fd2dfe54 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:25.377069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcae764-4f48-4b6d-9e16-7ce687875268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:25.377243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae764-4f48-4b6d-9e16-7ce687875268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.377627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae764-4f48-4b6d-9e16-7ce687875268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.377907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae764-4f48-4b6d-9e16-7ce687875268 admin admin] PATH_INFO: `/v3/projects/f7d61b73d7194df6a0207b0270fcb7ea/users/5bcf70fe5f2a47abb5d04111957a753c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.404327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcae764-4f48-4b6d-9e16-7ce687875268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d61b73d7194df6a0207b0270fcb7ea, user_id=5bcf70fe5f2a47abb5d04111957a753c, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:25.415278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67cb21ac18248e0a502ae5e34699028'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.416202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67cb21ac18248e0a502ae5e34699028'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.417893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcae764-4f48-4b6d-9e16-7ce687875268 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:25.434845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67cb21ac18248e0a502ae5e34699028'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.454522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67cb21ac18248e0a502ae5e34699028'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.458118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67cb21ac18248e0a502ae5e34699028'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:25.518808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 923/1839] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:25 2022] PUT /identity/v3/projects/f7d61b73d7194df6a0207b0270fcb7ea/users/5bcf70fe5f2a47abb5d04111957a753c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:25.525471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.525770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.526048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.545042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 917/1840] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:25 2022] DELETE /identity/v3/users/b67cb21ac18248e0a502ae5e34699028 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:25.577479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] MFA Rules not processed for user `5bcf70fe5f2a47abb5d04111957a753c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:25.578830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:25.684773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 924/1841] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:25.689273 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.690984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:25.780987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b2c6c-a5b6-42e0-b6bb-b06a0e523dbe admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:25.785814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:25.786436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:25.786736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:25.786991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:25.787662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:25.789611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:25.965997 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 918/1842] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:25 2022] POST /identity/v3/projects => generated 369 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:25.967633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:25.981499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f0f7-4309-4529-b2b9-bb0154055e7c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.051710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.052394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.053059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.053164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.053817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.055888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.143734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 925/1843] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:25 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:26.149182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.159437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8615efd-27b9-4543-844c-cbd41a64411c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.164294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.165219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.165610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.165963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.166756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.168918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.179724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 919/1844] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:26.183959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.193377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:26.197572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467be9b-ab55-4c28-ba0a-36353c8d8d48 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.202922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.203615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.204012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.204296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] PATH_INFO: `/v3/projects/69cac7331447499db9c7e3c9a1c0f094/users/9559596c8b4341eab29cbda940bc300a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.220250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cac7331447499db9c7e3c9a1c0f094, user_id=9559596c8b4341eab29cbda940bc300a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.223045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.250805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.252887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:26.267845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd509-e787-474e-b2b4-3b84925849f4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.272943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.273661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.274007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.274351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] PATH_INFO: `/v3/projects/e99af7fe0a96425ea4efc083f624a6bd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.275743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99af7fe0a96425ea4efc083f624a6bd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.277674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.300827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 926/1845] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:26 2022] PUT /identity/v3/projects/69cac7331447499db9c7e3c9a1c0f094/users/9559596c8b4341eab29cbda940bc300a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:26.304587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.366643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d349-a2bb-4ea0-be7c-3a6c48389342 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.371973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.373191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.373191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.373382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.374157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.375777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.387563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 927/1846] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:26.392269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.399372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99af7fe0a96425ea4efc083f624a6bd', 'request_id': 'req-9b6b4f51-240d-4263-97dd-fa5ee6b64980'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:26.407585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99af7fe0a96425ea4efc083f624a6bd', 'request_id': 'req-9b6b4f51-240d-4263-97dd-fa5ee6b64980'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:26.410783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4019f-e676-4631-a068-1b1db02670e7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.413558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99af7fe0a96425ea4efc083f624a6bd', 'request_id': 'req-9b6b4f51-240d-4263-97dd-fa5ee6b64980'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:26.470121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ea869-c1ba-427b-9ff5-a78b4cb85968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.470790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea869-c1ba-427b-9ff5-a78b4cb85968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.471104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea869-c1ba-427b-9ff5-a78b4cb85968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.471380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea869-c1ba-427b-9ff5-a78b4cb85968 admin admin] PATH_INFO: `/v3/projects/69cac7331447499db9c7e3c9a1c0f094/users/9559596c8b4341eab29cbda940bc300a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.473337 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ea869-c1ba-427b-9ff5-a78b4cb85968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cac7331447499db9c7e3c9a1c0f094, user_id=9559596c8b4341eab29cbda940bc300a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.475965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ea869-c1ba-427b-9ff5-a78b4cb85968 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.486268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 928/1847] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:26 2022] PUT /identity/v3/projects/69cac7331447499db9c7e3c9a1c0f094/users/9559596c8b4341eab29cbda940bc300a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:26.496537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.496863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.497140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.501806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] The token cache is being invalidate because project e99af7fe0a96425ea4efc083f624a6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:26.502201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:26.503068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9b6b4f51-240d-4263-97dd-fa5ee6b64980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:26.508463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 920/1848] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:26 2022] DELETE /identity/v3/projects/e99af7fe0a96425ea4efc083f624a6bd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:26.511061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43b17-f374-4eee-b0fc-f4e1174c2ae9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.511061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43b17-f374-4eee-b0fc-f4e1174c2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.511061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43b17-f374-4eee-b0fc-f4e1174c2ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.527034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] MFA Rules not processed for user `9559596c8b4341eab29cbda940bc300a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:26.528559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:26.546713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fcc43b17-f374-4eee-b0fc-f4e1174c2ae9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:26.547924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fcc43b17-f374-4eee-b0fc-f4e1174c2ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:26.652477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 929/1849] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:26.677464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 921/1850] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:26.677915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.677915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:26.682585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.682963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.683251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.708181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:26.710110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:26.721962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 922/1851] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:26.726202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.737802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811875f-d16e-412e-83ae-703abfefccf9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.743034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.743871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.744121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.752236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.753131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:26.754132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.762588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.775669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61427652-1e92-4966-ac93-fb424e9b4290 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.792778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 923/1852] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:40:26.792954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.792954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.792954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.792954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.794476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.805778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.807894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.809383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da7c21-6d9c-4243-8f45-4fba41d0edae admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:26.823841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:26.824469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:26.824771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:26.825053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:26.825292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 930/1853] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:26.825724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:26.828502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:26.965899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 924/1854] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:26 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:26.970014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:26.982423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c7c3-5007-4df3-9cde-e452ec0dade8 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:27.081553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:27.082344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:27.082628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:27.082905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:27.084550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:27.087387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:27.227772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 931/1855] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:26 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:27.235889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:27.258419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206408a1-3816-4ebf-85c9-90653a691c66 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:27.269135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:27.269825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:27.270519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:27.270947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:27.271889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:27.273994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:27.298038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 925/1856] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:27.301707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:27.313762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7b49-96a3-412c-818e-4f5746dbd9db admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:27.318754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5d1ac-09bd-4490-a614-62d6a5815c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:27.319612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5d1ac-09bd-4490-a614-62d6a5815c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:27.320040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5d1ac-09bd-4490-a614-62d6a5815c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:27.320378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5d1ac-09bd-4490-a614-62d6a5815c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:27.321343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5d1ac-09bd-4490-a614-62d6a5815c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:27.323013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5d1ac-09bd-4490-a614-62d6a5815c18 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:27.339678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:27.341126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 932/1857] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:27.355884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c3076-c7fe-4274-b346-180820fabffb admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:27.362073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:27.362884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:27.363660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:27.363660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] PATH_INFO: `/v3/projects/e2f759f9e28f408da5bd1ea74460c4ea/users/c250190dab954364831e8225c5ea1f2c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:27.386629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f759f9e28f408da5bd1ea74460c4ea, user_id=c250190dab954364831e8225c5ea1f2c, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:27.390130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:27.479603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 926/1858] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:27 2022] PUT /identity/v3/projects/e2f759f9e28f408da5bd1ea74460c4ea/users/c250190dab954364831e8225c5ea1f2c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:27.490930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:27.491220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:27.491498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:27.543058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] MFA Rules not processed for user `c250190dab954364831e8225c5ea1f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:27.544784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:27.579142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:27.635448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 933/1859] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:27.650013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:27.652054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:27.693422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:27.742454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee8954-2d48-4ac6-a6fb-fb2a7bbfe8c5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:27.746533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:27.747172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:27.747459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:27.755559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:27.761852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:27.763609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:27.793181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 927/1860] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:28.887470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:28.897493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c5140-6b65-447c-9761-3fb91623a48b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:28.901058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:28.901680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:28.901960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:28.902231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:28.905970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:28.969462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:28.970907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209a869-d72d-47d8-9bf0-fead3725d54e service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:28.980323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 934/1861] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:29.276314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:29.338458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:30.943880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:30.948097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:31.053114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4986a-c89d-44ea-84fe-493448f6f343 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:31.058221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:31.059043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:31.059477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:31.059900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] PATH_INFO: `/v3/users/5bcf70fe5f2a47abb5d04111957a753c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:31.061871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcf70fe5f2a47abb5d04111957a753c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:31.072085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:31.254188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcf70fe5f2a47abb5d04111957a753c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:31.255030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcf70fe5f2a47abb5d04111957a753c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:31.267163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:31.268850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcf70fe5f2a47abb5d04111957a753c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:31.293541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcf70fe5f2a47abb5d04111957a753c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:31.295318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcf70fe5f2a47abb5d04111957a753c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:31.333686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:31.394123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 928/1862] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:30 2022] DELETE /identity/v3/users/5bcf70fe5f2a47abb5d04111957a753c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:31.398872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:31.399228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:31.399632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:31.424516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:31.425158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:31.505775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 935/1863] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:31.528802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:31.531474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:31.615764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa007b5-57cd-4911-90a2-7cd49d2037c1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:31.619704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:31.620476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:31.625228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:31.625727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:31.638384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:31.642778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:31.653832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 929/1864] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:32.363297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:32.365410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:32.380245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a89dd-5faa-4a51-a1e3-f4fb05d45520 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:32.412572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:32.413354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:32.414438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:32.414725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] PATH_INFO: `/v3/projects/f7d61b73d7194df6a0207b0270fcb7ea` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:32.416974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d61b73d7194df6a0207b0270fcb7ea)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:32.422189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:32.575843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d61b73d7194df6a0207b0270fcb7ea', 'request_id': 'req-3c8efd51-8ba5-4060-b5f3-9d115da8c239'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:32.589478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d61b73d7194df6a0207b0270fcb7ea', 'request_id': 'req-3c8efd51-8ba5-4060-b5f3-9d115da8c239'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:32.595940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d61b73d7194df6a0207b0270fcb7ea', 'request_id': 'req-3c8efd51-8ba5-4060-b5f3-9d115da8c239'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:32.634250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:32.637529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:32.654485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f150-c443-46d1-a062-c88e2dda8405 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:32.684924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] The token cache is being invalidate because project f7d61b73d7194df6a0207b0270fcb7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:32.687397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:32.688690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:32.693299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 936/1865] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:32 2022] DELETE /identity/v3/projects/f7d61b73d7194df6a0207b0270fcb7ea => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:32.699864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:32.713580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:32.758537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:32.759883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:32.760247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:32.760665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] PATH_INFO: `/v3/users/c250190dab954364831e8225c5ea1f2c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:32.762128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c250190dab954364831e8225c5ea1f2c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:32.765078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:32.839220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8efd51-8ba5-4060-b5f3-9d115da8c239 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:32.845818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:32.846517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:32.846799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:32.847070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] PATH_INFO: `/v3/users/9559596c8b4341eab29cbda940bc300a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:32.848269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9559596c8b4341eab29cbda940bc300a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:32.851004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:32.860089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:32.954141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:32.998001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c250190dab954364831e8225c5ea1f2c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:32.999650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c250190dab954364831e8225c5ea1f2c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.007322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c250190dab954364831e8225c5ea1f2c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.020629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c250190dab954364831e8225c5ea1f2c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.021602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a9c7a17d-8ace-4647-a9f1-8ab389cad6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c250190dab954364831e8225c5ea1f2c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.085092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9559596c8b4341eab29cbda940bc300a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.111529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 930/1866] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:32 2022] DELETE /identity/v3/users/c250190dab954364831e8225c5ea1f2c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:33.121824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:33.123806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:33.125003 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:33.149700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:33.150942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:33.215663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9559596c8b4341eab29cbda940bc300a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.226733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 931/1867] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:33.229421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9559596c8b4341eab29cbda940bc300a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.230821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9559596c8b4341eab29cbda940bc300a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.231993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9559596c8b4341eab29cbda940bc300a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:33.237921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:33.239774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:33.259741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 937/1868] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:32 2022] DELETE /identity/v3/users/9559596c8b4341eab29cbda940bc300a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:33.336033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6071c-9c0a-4a04-a7a6-f6490a45c9ea None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:33.440075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:33.441084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:33.441646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:33.441812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:33.444317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:33.602961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:33.604611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:33.649000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 932/1869] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:33.908996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:33.911178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:33.927350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:33.929052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:33.935203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dda7d5-ceb8-4432-8f77-3b063bbe4bd3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:33.945886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092829d-35ae-41ae-a535-4970f0a27deb service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:33.952658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:33.953456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:33.953966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:33.954082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:33.954372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:33.954481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:33.954776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] PATH_INFO: `/v3/projects/69cac7331447499db9c7e3c9a1c0f094` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:33.954884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] PATH_INFO: `/v3/users/91922a5d4cf94cef8ceff4a2b540e4a1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:33.956186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cac7331447499db9c7e3c9a1c0f094)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:33.957690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91922a5d4cf94cef8ceff4a2b540e4a1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:33.958265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:33.961480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:34.101068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cac7331447499db9c7e3c9a1c0f094', 'request_id': 'req-541d8711-c38e-4dfd-95df-56df78e35cd7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.109922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cac7331447499db9c7e3c9a1c0f094', 'request_id': 'req-541d8711-c38e-4dfd-95df-56df78e35cd7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.116968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cac7331447499db9c7e3c9a1c0f094', 'request_id': 'req-541d8711-c38e-4dfd-95df-56df78e35cd7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.197692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] The token cache is being invalidate because project 69cac7331447499db9c7e3c9a1c0f094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:34.197992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.198723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-541d8711-c38e-4dfd-95df-56df78e35cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.200529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 933/1870] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:33 2022] DELETE /identity/v3/projects/69cac7331447499db9c7e3c9a1c0f094 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:34.206165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166eb6-fb8f-4126-910b-31860a2d08bc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.206505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166eb6-fb8f-4126-910b-31860a2d08bc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.206790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166eb6-fb8f-4126-910b-31860a2d08bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.211838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91922a5d4cf94cef8ceff4a2b540e4a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.251718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-69166eb6-fb8f-4126-910b-31860a2d08bc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:34.253311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-69166eb6-fb8f-4126-910b-31860a2d08bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.301101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91922a5d4cf94cef8ceff4a2b540e4a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.312927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91922a5d4cf94cef8ceff4a2b540e4a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.313869 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91922a5d4cf94cef8ceff4a2b540e4a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.314685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91922a5d4cf94cef8ceff4a2b540e4a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.338876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 934/1871] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:34.340870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e05da-5866-4345-872a-b1b4dd8ec285 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.341166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e05da-5866-4345-872a-b1b4dd8ec285 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.341447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e05da-5866-4345-872a-b1b4dd8ec285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.353139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 938/1872] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:33 2022] DELETE /identity/v3/users/91922a5d4cf94cef8ceff4a2b540e4a1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:34.364193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:34.366316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.367258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b44e05da-5866-4345-872a-b1b4dd8ec285 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:34.370737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b44e05da-5866-4345-872a-b1b4dd8ec285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.451038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 935/1873] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:34.451038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.451038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.451038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.460415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2086c7-661e-42ec-b4f0-0906cedb5657 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:34.471417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:34.472089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.472325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:34.472432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.472628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] PATH_INFO: `/v3/projects/e2f759f9e28f408da5bd1ea74460c4ea` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.473931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f759f9e28f408da5bd1ea74460c4ea)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:34.474463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.475966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:34.491861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 936/1874] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:34.492888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:34.537359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d77bcd-5318-472f-993d-2c627992db24 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:34.546275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704922-18a7-4a31-a922-889958714eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:34.547127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704922-18a7-4a31-a922-889958714eba admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.547880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704922-18a7-4a31-a922-889958714eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.548052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704922-18a7-4a31-a922-889958714eba admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.548933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704922-18a7-4a31-a922-889958714eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:34.552303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704922-18a7-4a31-a922-889958714eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:34.552303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704922-18a7-4a31-a922-889958714eba admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:34.570729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:34.574186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 937/1875] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:34.579248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704922-18a7-4a31-a922-889958714eba admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:34.588505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-57704922-18a7-4a31-a922-889958714eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.635458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f759f9e28f408da5bd1ea74460c4ea', 'request_id': 'req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.647910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f759f9e28f408da5bd1ea74460c4ea', 'request_id': 'req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.656627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f759f9e28f408da5bd1ea74460c4ea', 'request_id': 'req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.735910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] The token cache is being invalidate because project e2f759f9e28f408da5bd1ea74460c4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:34.735910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.736517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:34.746064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 939/1876] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:34 2022] DELETE /identity/v3/projects/e2f759f9e28f408da5bd1ea74460c4ea => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:34.748115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:34.753930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.766430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704922-18a7-4a31-a922-889958714eba admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:34.890447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:34.891085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.891369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.891639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.894817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.911311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:34.912104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af20c6-df8b-4f7c-a3c2-bf4544c700dc service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:34.924424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 938/1877] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:34.925767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664ad5-e647-4e12-bc93-490a27669798 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.926054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664ad5-e647-4e12-bc93-490a27669798 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.926329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664ad5-e647-4e12-bc93-490a27669798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.938072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc1035-723a-4e5d-b3fd-b42bbae77d1e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:34.951335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:34.952510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.953850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.954555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-44664ad5-e647-4e12-bc93-490a27669798 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:34.954906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:34.955781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-44664ad5-e647-4e12-bc93-490a27669798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:34.957822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:34.962971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:34.969366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 939/1878] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:34.978425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:34.978874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:34.988869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.010693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:35.012119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:35.026871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 940/1879] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:35.028088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.040083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc6c9-6aa9-4320-ad83-9799c96d0814 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.063438 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.064758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.065052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.067117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.067886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:35.068215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.069878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.098017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 940/1880] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:34 2022] POST /identity/v3/projects => generated 387 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:35.102491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.106612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 941/1881] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:35.110124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.125265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720442-4594-4181-8cce-9b0fcac52b60 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.224136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.226971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.227718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.228115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.228996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.230122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172067-f0d3-486f-af06-210f7e8e90c4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.232479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.236149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.237395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.237855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.238298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.239435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.241957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.396781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 941/1882] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:35 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:35.399174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.405917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 942/1883] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:35 2022] POST /identity/v3/projects => generated 371 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:35.413179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27765632-e270-4854-b6a0-b56e8078788c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.417933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.520939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.521819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.522454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.523149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.524079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.527387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.558362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 942/1884] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:35.561963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.586825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52cf8-55f8-482b-990f-e39bb015930e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.601487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.603982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.604566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.606288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa56c7-64d2-4a2b-84c1-78e620324171 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.606676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.608920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.609766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:35.611993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.624235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.625183 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.626034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.626462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.627338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.640750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.658407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 943/1885] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:35.661014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.675045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3055-81b2-45a0-aa07-0acae1dfb97b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.680839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb06d6-fa58-465c-92b0-56c9dda2c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.681808 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb06d6-fa58-465c-92b0-56c9dda2c0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.683039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb06d6-fa58-465c-92b0-56c9dda2c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.683386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb06d6-fa58-465c-92b0-56c9dda2c0e3 admin admin] PATH_INFO: `/v3/projects/6a0b43a48cf9409aa9aacafbda954539/users/fba606a4e21d446e9588068aa0f38d5f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.710038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb06d6-fa58-465c-92b0-56c9dda2c0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0b43a48cf9409aa9aacafbda954539, user_id=fba606a4e21d446e9588068aa0f38d5f, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.713257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb06d6-fa58-465c-92b0-56c9dda2c0e3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.792522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 943/1886] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:35 2022] POST /identity/v3/users => generated 286 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:35.796687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.807278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3279-b12a-4e28-9d27-57af61540081 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.812611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.813220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.813521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.814141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.818261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.818261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.827649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 944/1887] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:35.831986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.847127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261939b4-6bc0-4316-90fc-a7ef6f6ffb1a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.851913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 944/1888] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:35 2022] PUT /identity/v3/projects/6a0b43a48cf9409aa9aacafbda954539/users/fba606a4e21d446e9588068aa0f38d5f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:35.874049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.874573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.875309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.914765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] MFA Rules not processed for user `fba606a4e21d446e9588068aa0f38d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:35.916661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:35.931214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.932026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.932468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.932843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.933886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:35.936178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:35.952302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 945/1889] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:35.953704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:35.965291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a661b3-1399-4282-b960-ac26a35af0b6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:35.971391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589636-cbe5-4e2e-8c25-8cec1e2411ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:35.972137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589636-cbe5-4e2e-8c25-8cec1e2411ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:35.972429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589636-cbe5-4e2e-8c25-8cec1e2411ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:35.972714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589636-cbe5-4e2e-8c25-8cec1e2411ef admin admin] PATH_INFO: `/v3/projects/f040f79e9a3c411696e00ed0c6fd5f93/users/c485837e09c946f3b391e2bf6ae88322/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:35.997714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589636-cbe5-4e2e-8c25-8cec1e2411ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f040f79e9a3c411696e00ed0c6fd5f93, user_id=c485837e09c946f3b391e2bf6ae88322, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.004629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589636-cbe5-4e2e-8c25-8cec1e2411ef admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.013736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 945/1890] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:36.015301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.031489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637cc9d-b279-409f-a234-5daad8d69d85 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.037476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.038381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.038735 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.039063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.039752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.041886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.125657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 946/1891] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:35 2022] PUT /identity/v3/projects/f040f79e9a3c411696e00ed0c6fd5f93/users/c485837e09c946f3b391e2bf6ae88322/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:36.131167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.131593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.132007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.156387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 946/1892] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:36 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:36.158095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:36.159312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.159691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:36.238512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:36.245871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51429d6d-0a64-42f9-93f3-a7be150b6c37 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.252978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.254644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.256284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.257720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.258801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.259449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 947/1893] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:36.265098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.270210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.272205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:36.346963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489fc3-e51d-459e-a652-50bcbd862de3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.350832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.351829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.352082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.352792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.363032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.364499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.376960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 948/1894] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:36.377724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 947/1895] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:36 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:36.381586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.395941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f57b-3173-46f7-b9cc-9b99c8a1377b service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.401915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.402682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.403335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.403706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.405324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.407140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.421194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 949/1896] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:36.422964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.449507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219662-a15d-458b-976f-3e1c916bae92 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.456799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.457495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.457784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.458049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] PATH_INFO: `/v3/projects/d9f7a7d8aa094e32ad98f8d8aa8a5bf6/users/1a8c11e30a9546be889e2cb787b4e813/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.476098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f7a7d8aa094e32ad98f8d8aa8a5bf6, user_id=1a8c11e30a9546be889e2cb787b4e813, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.479297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.564757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.566747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:36.582121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118940b5-5803-4238-aeb6-cf0bcb2f0b92 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.587025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.588779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.589143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.589487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] PATH_INFO: `/v3/projects/5bfc35dab261404bb44cc5faf694eeb4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.590921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfc35dab261404bb44cc5faf694eeb4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.593753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.599956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 948/1897] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:36 2022] PUT /identity/v3/projects/d9f7a7d8aa094e32ad98f8d8aa8a5bf6/users/1a8c11e30a9546be889e2cb787b4e813/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:36.604375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.693009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e1edf-636a-4df1-b588-9ef834d28845 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.697995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.698619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.698907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.699186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.699885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.702242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.713864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 949/1898] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:36.721199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.734246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfc35dab261404bb44cc5faf694eeb4', 'request_id': 'req-08ab962a-12db-47a5-9d4e-43e49626cd8f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:36.736840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b0a22-8482-4cdb-a0e4-40cdc99cc2da admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.746095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfc35dab261404bb44cc5faf694eeb4', 'request_id': 'req-08ab962a-12db-47a5-9d4e-43e49626cd8f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:36.754833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfc35dab261404bb44cc5faf694eeb4', 'request_id': 'req-08ab962a-12db-47a5-9d4e-43e49626cd8f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:36.808680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd6491-5747-4fae-af55-d26d8c25390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.809540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd6491-5747-4fae-af55-d26d8c25390b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.809922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd6491-5747-4fae-af55-d26d8c25390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.810575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd6491-5747-4fae-af55-d26d8c25390b admin admin] PATH_INFO: `/v3/projects/d9f7a7d8aa094e32ad98f8d8aa8a5bf6/users/1a8c11e30a9546be889e2cb787b4e813/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.813391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd6491-5747-4fae-af55-d26d8c25390b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f7a7d8aa094e32ad98f8d8aa8a5bf6, user_id=1a8c11e30a9546be889e2cb787b4e813, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.816563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd6491-5747-4fae-af55-d26d8c25390b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.828548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 950/1899] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:36 2022] PUT /identity/v3/projects/d9f7a7d8aa094e32ad98f8d8aa8a5bf6/users/1a8c11e30a9546be889e2cb787b4e813/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:36.841152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.842517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.843078 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.850837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] The token cache is being invalidate because project 5bfc35dab261404bb44cc5faf694eeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:36.851759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:36.852699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:36.854545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 950/1900] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:36 2022] DELETE /identity/v3/projects/5bfc35dab261404bb44cc5faf694eeb4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:36.859041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:36.860410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:36.877192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab962a-12db-47a5-9d4e-43e49626cd8f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:36.878727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] MFA Rules not processed for user `1a8c11e30a9546be889e2cb787b4e813`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:36.880171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:36.939047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:36.939936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:36.940298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:36.940683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] PATH_INFO: `/v3/users/87ce5838e9c643c3ac96402f6b912ab8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:36.942041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ce5838e9c643c3ac96402f6b912ab8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:36.944098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:36.982375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 951/1901] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:36.996566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:37.002294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:37.078065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63e03-e2e9-4794-b14d-5820c7fb8067 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:37.082782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:37.084035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:37.084437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:37.084743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:37.103316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:37.105425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:37.126443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 952/1902] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:37.135661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ce5838e9c643c3ac96402f6b912ab8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.136775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ce5838e9c643c3ac96402f6b912ab8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.159263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ce5838e9c643c3ac96402f6b912ab8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.161822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:37.163405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:37.173410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ce5838e9c643c3ac96402f6b912ab8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.174234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f594e867-49b3-45a3-a445-e979612f9204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ce5838e9c643c3ac96402f6b912ab8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.178615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1359f-e389-4004-aea6-5f1454428c4f service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:37.183519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:37.184143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:37.184424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:37.184790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] PATH_INFO: `/v3/users/fba606a4e21d446e9588068aa0f38d5f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:37.186545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba606a4e21d446e9588068aa0f38d5f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:37.188476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:37.244139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 951/1903] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:36 2022] DELETE /identity/v3/users/87ce5838e9c643c3ac96402f6b912ab8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:37.390082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba606a4e21d446e9588068aa0f38d5f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.486646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba606a4e21d446e9588068aa0f38d5f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.499361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba606a4e21d446e9588068aa0f38d5f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.500137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba606a4e21d446e9588068aa0f38d5f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.515868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba606a4e21d446e9588068aa0f38d5f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:37.561068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 953/1904] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:37 2022] DELETE /identity/v3/users/fba606a4e21d446e9588068aa0f38d5f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:37.565640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:37.566320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:37.567032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:37.605431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:37.607747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:37.661975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:37.700378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:37.741377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 952/1905] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:37.753709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:37.755596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:37.817938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c67d6-2aa7-4c86-81ad-59af0f241ec9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:37.821738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:37.822452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:37.822732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:37.823002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:37.832519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:37.833989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:37.844116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 954/1906] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:37.890141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:37.891797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:37.934686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f503-7702-4005-9c5c-c408b9588521 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:37.949547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:37.950442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:37.950875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:37.951331 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] PATH_INFO: `/v3/projects/e5403181105344678821f7a64eae858f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:37.953280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5403181105344678821f7a64eae858f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:37.955444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:38.087963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5403181105344678821f7a64eae858f', 'request_id': 'req-53163e14-9ba4-4c27-b9c2-8298ea963168'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.099598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5403181105344678821f7a64eae858f', 'request_id': 'req-53163e14-9ba4-4c27-b9c2-8298ea963168'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.111803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5403181105344678821f7a64eae858f', 'request_id': 'req-53163e14-9ba4-4c27-b9c2-8298ea963168'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.214899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] The token cache is being invalidate because project e5403181105344678821f7a64eae858f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:38.215206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.219459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-53163e14-9ba4-4c27-b9c2-8298ea963168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.221224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 953/1907] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:37 2022] DELETE /identity/v3/projects/e5403181105344678821f7a64eae858f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:38.225914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:38.253745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379edf5-e447-4b90-936d-d8ab3651fa89 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:38.293755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:38.294262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:38.294760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:38.355250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] MFA Rules not processed for user `c485837e09c946f3b391e2bf6ae88322`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:38.358590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:38.386776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:38.387717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:38.387972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:38.388889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] PATH_INFO: `/v3/users/713e221d783d456fa108067e7239057a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:38.390530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] RBAC: Authorizing `identity:delete_user(user_id=713e221d783d456fa108067e7239057a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:38.392611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:38.458533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 954/1908] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:38.476574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:38.480789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:38.600137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713e221d783d456fa108067e7239057a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.602000 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9295-b7f5-43d3-975d-986695b0ff96 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:38.609558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:38.610524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:38.610817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:38.611093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:38.632335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:38.634116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:38.657873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 955/1909] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:38.658818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:38.661884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:38.696175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6470e-c0cf-40e8-96c6-e15758bdbd23 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:38.698834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713e221d783d456fa108067e7239057a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.713369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:38.714068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:38.714358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:38.714770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] PATH_INFO: `/v3/projects/6a0b43a48cf9409aa9aacafbda954539` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:38.715075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713e221d783d456fa108067e7239057a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.716106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713e221d783d456fa108067e7239057a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.717405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713e221d783d456fa108067e7239057a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.719973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0b43a48cf9409aa9aacafbda954539)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:38.721970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:38.745621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 955/1910] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:38 2022] DELETE /identity/v3/users/713e221d783d456fa108067e7239057a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:38.915857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0b43a48cf9409aa9aacafbda954539', 'request_id': 'req-9f149a2d-cbde-4775-82b3-3e3211d76df5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.923310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0b43a48cf9409aa9aacafbda954539', 'request_id': 'req-9f149a2d-cbde-4775-82b3-3e3211d76df5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:38.929339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0b43a48cf9409aa9aacafbda954539', 'request_id': 'req-9f149a2d-cbde-4775-82b3-3e3211d76df5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.007244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] The token cache is being invalidate because project 6a0b43a48cf9409aa9aacafbda954539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:39.012809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.012809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.012809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 956/1911] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:38 2022] DELETE /identity/v3/projects/6a0b43a48cf9409aa9aacafbda954539 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:39.015381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:39.016970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:39.094082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3bd5f-7c42-472f-9790-962decab460e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:39.154730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:39.155384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.155666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.156029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] PATH_INFO: `/v3/users/1a8c11e30a9546be889e2cb787b4e813` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.157155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8c11e30a9546be889e2cb787b4e813)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:39.159120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:39.244708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:39.246271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:39.259859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149a2d-cbde-4775-82b3-3e3211d76df5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:39.265079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:39.265758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.266039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.266314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] PATH_INFO: `/v3/projects/229b6ab9a59248f7ade496c813e59276` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.267807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229b6ab9a59248f7ade496c813e59276)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:39.269786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:39.343045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8c11e30a9546be889e2cb787b4e813'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.380071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229b6ab9a59248f7ade496c813e59276', 'request_id': 'req-3625bdcf-7b33-4c4c-82d3-41e0027705b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.387382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229b6ab9a59248f7ade496c813e59276', 'request_id': 'req-3625bdcf-7b33-4c4c-82d3-41e0027705b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.394581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229b6ab9a59248f7ade496c813e59276', 'request_id': 'req-3625bdcf-7b33-4c4c-82d3-41e0027705b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.414713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8c11e30a9546be889e2cb787b4e813'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.423660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8c11e30a9546be889e2cb787b4e813'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.424510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8c11e30a9546be889e2cb787b4e813'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.425321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-80221169-8472-4f96-b3c6-566eb4a8e3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8c11e30a9546be889e2cb787b4e813'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.447350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 956/1912] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:39 2022] DELETE /identity/v3/users/1a8c11e30a9546be889e2cb787b4e813 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:39.527687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] The token cache is being invalidate because project 229b6ab9a59248f7ade496c813e59276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:39.528784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.530079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3625bdcf-7b33-4c4c-82d3-41e0027705b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:39.533421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 957/1913] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:39 2022] DELETE /identity/v3/projects/229b6ab9a59248f7ade496c813e59276 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:39.541443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.542031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.542516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.571809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:39.573979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:39.643688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 957/1914] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:39.652022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.652312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.652591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.673387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:39.674587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:39.682588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 958/1915] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:39.686927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:39.696756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ad8d5-8f14-42ce-a5b4-7619e967e65c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:39.702258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:39.702881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.704198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.704516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.707166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:39.707166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:39.707580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:39.719926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 958/1916] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:39.724441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:39.738451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26edcf-0802-43f2-a6e1-dd4060998772 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:39.753933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:39.755140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.755437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.755718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.756412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:39.758421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:39.868290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 959/1917] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:39 2022] POST /identity/v3/projects => generated 399 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:39.872758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:39.883341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e69a8-c67f-43a5-bcb6-3009a6888cfb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:39.886353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:39.949214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:39.949843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:39.950129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:39.951854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:39.951854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:39.953690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:39.986647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:40.023976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.027326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:40.046405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4daca-e6dd-4a23-af9a-4f9c07c8e737 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.052704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.053841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.054442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.055340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] PATH_INFO: `/v3/projects/d9f7a7d8aa094e32ad98f8d8aa8a5bf6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.056006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 959/1918] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:39 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:40.056916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f7a7d8aa094e32ad98f8d8aa8a5bf6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.059088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.059675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.072925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ef1d-64eb-4049-bae6-3160ab1bee5c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.080561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.081406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.081633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.081984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.082607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.084267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.095587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 960/1919] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:40.099854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.110063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2889c-a037-4bd6-bbb8-a9d8826101fc admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.115169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.115955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.116238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.116514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.117242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.118905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.129926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 961/1920] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:40.133993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.143937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4bd5c-f1f5-4d74-870c-2f3bf16eceb6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.148807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d0d07-732c-4c3a-92f9-1f7ca273cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.149437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d0d07-732c-4c3a-92f9-1f7ca273cecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.149720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d0d07-732c-4c3a-92f9-1f7ca273cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.150107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d0d07-732c-4c3a-92f9-1f7ca273cecd admin admin] PATH_INFO: `/v3/projects/f85684a0c43f4316878eb25fd43dc4fe/users/5d410a359aeb4a939c69c6540b90a328/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.164317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d0d07-732c-4c3a-92f9-1f7ca273cecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85684a0c43f4316878eb25fd43dc4fe, user_id=5d410a359aeb4a939c69c6540b90a328, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.167008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d0d07-732c-4c3a-92f9-1f7ca273cecd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.260611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 962/1921] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:40 2022] PUT /identity/v3/projects/f85684a0c43f4316878eb25fd43dc4fe/users/5d410a359aeb4a939c69c6540b90a328/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:40.269569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f7a7d8aa094e32ad98f8d8aa8a5bf6', 'request_id': 'req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:40.273399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.273686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.273959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.276076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f7a7d8aa094e32ad98f8d8aa8a5bf6', 'request_id': 'req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:40.281832 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f7a7d8aa094e32ad98f8d8aa8a5bf6', 'request_id': 'req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:40.301999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] MFA Rules not processed for user `5d410a359aeb4a939c69c6540b90a328`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:40.303252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:40.339965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] The token cache is being invalidate because project d9f7a7d8aa094e32ad98f8d8aa8a5bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:40.340439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:40.341070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0e46138b-e4ea-4d27-81ca-53ec4e73a75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:40.342833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 960/1922] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:40 2022] DELETE /identity/v3/projects/d9f7a7d8aa094e32ad98f8d8aa8a5bf6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:40.348607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5157-58ec-4ec3-81a3-daec3277a83c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.348935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5157-58ec-4ec3-81a3-daec3277a83c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.349220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5157-58ec-4ec3-81a3-daec3277a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.369469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:40.370043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-580d5157-58ec-4ec3-81a3-daec3277a83c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:40.375784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-580d5157-58ec-4ec3-81a3-daec3277a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:40.378968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.380275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:40.430366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 961/1924] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:40.439103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.439390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.439665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.445930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42283a2-4b6f-4dfc-8c34-6f8827b1401b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.452753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.453394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.454171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.454501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.455177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.457113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.459297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:40.460481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:40.468803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 962/1925] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:40.472835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.481788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954e8e-56dd-46d5-9431-c7ff3cf51ce0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.486889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.487965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.487965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.488129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.488686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:40.489007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.490579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.502598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 963/1926] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:40:40.506917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.516908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ef9d-b00e-40e7-a271-ba9aacf12c5b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.521762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.522382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.522673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.522956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.523630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.525710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.541989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 964/1927] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/projects => generated 401 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:40.543460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.605210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9230-fd42-4daf-9e88-08bfd46fa9dd admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.611066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b744376-0249-4ea6-b86b-ac07725d97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.611680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b744376-0249-4ea6-b86b-ac07725d97b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.611959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b744376-0249-4ea6-b86b-ac07725d97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.612230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b744376-0249-4ea6-b86b-ac07725d97b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.612913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b744376-0249-4ea6-b86b-ac07725d97b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.614851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b744376-0249-4ea6-b86b-ac07725d97b0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.639062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 964/1928] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:40.643260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.698079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 965/1929] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/users => generated 307 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:40.699368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.699655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.699932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.705474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a5698-28a9-40d4-8b09-f7cc1ba773d8 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.711721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.712353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.712642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.712955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.713633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.715590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.719106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] MFA Rules not processed for user `c485837e09c946f3b391e2bf6ae88322`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:40.720277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:40.775224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 966/1930] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:40.776131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.786778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bb82b-db45-4da3-8e3e-c59bba65a1df None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.791395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.797909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.797909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.797909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.797909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.797909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.808660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 967/1931] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:40.809880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.820581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd546a3-bd5f-415c-941a-a869e6bef61e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.825988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.826662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.830071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.830739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 965/1932] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:40 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:40.830982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] PATH_INFO: `/v3/projects/a8890d972c5649c78c1a8672a1b11d13/users/332c683beb5e4b38bfdf5efceedc98fe/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.831057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.842773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8540f4-15a9-4804-b318-678f4bfeb008 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.845911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8890d972c5649c78c1a8672a1b11d13, user_id=332c683beb5e4b38bfdf5efceedc98fe, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.847763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.848419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.848704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.848837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.849592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.849753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.851457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.865535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 966/1933] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:40.866591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.877269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99977c57-99ed-4428-85ce-216a54b87780 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.881846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.882503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.882768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.883045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.883727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.885339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.895824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 967/1934] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:40.900783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:40.910121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68c087-8283-45b6-a229-c1f61faae53a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:40.914726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec034ed-6447-4d4e-92de-73226280ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:40.915409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec034ed-6447-4d4e-92de-73226280ab6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:40.915689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec034ed-6447-4d4e-92de-73226280ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:40.916081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec034ed-6447-4d4e-92de-73226280ab6a admin admin] PATH_INFO: `/v3/projects/c410efb39cc64c71b3d35c8a77efa78b/users/f41c39884dc94f5ba9281519ceca5eb9/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:40.932809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec034ed-6447-4d4e-92de-73226280ab6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c410efb39cc64c71b3d35c8a77efa78b, user_id=f41c39884dc94f5ba9281519ceca5eb9, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:40.935637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec034ed-6447-4d4e-92de-73226280ab6a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:40.955874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 968/1935] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:40 2022] PUT /identity/v3/projects/a8890d972c5649c78c1a8672a1b11d13/users/332c683beb5e4b38bfdf5efceedc98fe/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:40.960656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:41.011057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 968/1936] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:40 2022] PUT /identity/v3/projects/c410efb39cc64c71b3d35c8a77efa78b/users/f41c39884dc94f5ba9281519ceca5eb9/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:41.024233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.024578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.024933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.026566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a89f6-f4fb-4b20-9c81-4c28f2eb09f4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:41.057291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] MFA Rules not processed for user `f41c39884dc94f5ba9281519ceca5eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:41.058569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:41.099422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:41.100247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.100538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.100836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.102684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:41.104535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:41.119663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 969/1937] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:41.120595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:41.136780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9639-b160-475f-85fc-db213ee6e812 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:41.141925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953c5b2-e4be-455e-bc37-39dcbeceaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:41.145675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953c5b2-e4be-455e-bc37-39dcbeceaab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.145798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 969/1938] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:41.145880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953c5b2-e4be-455e-bc37-39dcbeceaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.145880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953c5b2-e4be-455e-bc37-39dcbeceaab4 admin admin] PATH_INFO: `/v3/projects/a8890d972c5649c78c1a8672a1b11d13/users/332c683beb5e4b38bfdf5efceedc98fe/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.145880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953c5b2-e4be-455e-bc37-39dcbeceaab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8890d972c5649c78c1a8672a1b11d13, user_id=332c683beb5e4b38bfdf5efceedc98fe, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:41.150693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953c5b2-e4be-455e-bc37-39dcbeceaab4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:41.155813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:41.157739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:41.163966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 970/1939] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:41 2022] PUT /identity/v3/projects/a8890d972c5649c78c1a8672a1b11d13/users/332c683beb5e4b38bfdf5efceedc98fe/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:41.176893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.177184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.177455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.193657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:41.212246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] MFA Rules not processed for user `332c683beb5e4b38bfdf5efceedc98fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:41.213571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:41.230519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:41.261621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596d00-4ebc-4bf4-9db2-cadd898fc5e9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:41.305197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 971/1940] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:41.328870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:41.330002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:41.340482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:41.341175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.342149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.342344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.395863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca940330-5b3d-41cc-94f5-555fa21475bc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:41.401065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:41.401775 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.402089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.402473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.409378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:41.410973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:41.413777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:41.415225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:41.421860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 970/1941] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:41.425554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 972/1942] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:41.583942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:41.631882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:41.648756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9184b77-ce14-42f9-bb53-dd524ffd84f3 service glance] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:41.653488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8856a0b-7b89-487c-b5c8-36f6a095514e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:41.654683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8856a0b-7b89-487c-b5c8-36f6a095514e service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:41.655042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8856a0b-7b89-487c-b5c8-36f6a095514e service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:41.655436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8856a0b-7b89-487c-b5c8-36f6a095514e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:41.739979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8856a0b-7b89-487c-b5c8-36f6a095514e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:41.741907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8856a0b-7b89-487c-b5c8-36f6a095514e service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:41.753856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 971/1943] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:42.397672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:42.526585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:42.995105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:43.566980 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:43.632502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:44.366719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:44.452233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:44.826864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:44.913432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:45.206763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:45.253217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:45.418678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:45.483736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:46.005526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:47.207233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:47.272000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee3a4-f7fe-4e91-9852-335d9b4f2125 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:47.276852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:47.280466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:47.280466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:47.280466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] PATH_INFO: `/v3/users/5d410a359aeb4a939c69c6540b90a328` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:47.280466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d410a359aeb4a939c69c6540b90a328)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:47.281867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:47.529952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d410a359aeb4a939c69c6540b90a328'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:47.631634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d410a359aeb4a939c69c6540b90a328'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:47.639103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d410a359aeb4a939c69c6540b90a328'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:47.641914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d410a359aeb4a939c69c6540b90a328'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:47.641914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d410a359aeb4a939c69c6540b90a328'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:47.660409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 973/1944] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:47 2022] DELETE /identity/v3/users/5d410a359aeb4a939c69c6540b90a328 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:47.664986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:47.669497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:47.669497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:47.686237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:47.687736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:47.758006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 972/1945] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:47.765916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:47.768247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:47.826648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:47.839089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e43f8-cca5-4ddd-86f9-09513adca006 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:47.842692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:47.843309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:47.843595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:47.843915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:47.854453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:47.857630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:47.866216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 974/1946] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:48.465175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:48.467218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:48.487735 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076855-671b-4de0-95da-bc91fa34925f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:48.493750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:48.494110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:48.494396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:48.494676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] PATH_INFO: `/v3/projects/f85684a0c43f4316878eb25fd43dc4fe` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:48.495897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85684a0c43f4316878eb25fd43dc4fe)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:48.501851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:48.623235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:48.630935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85684a0c43f4316878eb25fd43dc4fe', 'request_id': 'req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:48.638810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85684a0c43f4316878eb25fd43dc4fe', 'request_id': 'req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:48.646047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85684a0c43f4316878eb25fd43dc4fe', 'request_id': 'req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:48.720895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] The token cache is being invalidate because project f85684a0c43f4316878eb25fd43dc4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:48.721681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:48.722073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:48.730494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 973/1947] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:48 2022] DELETE /identity/v3/projects/f85684a0c43f4316878eb25fd43dc4fe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:48.735299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:48.748212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3c44-5ba2-44e8-b49d-09b31eb970cb service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:48.820785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:48.821502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:48.821870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:48.822186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] PATH_INFO: `/v3/users/332c683beb5e4b38bfdf5efceedc98fe` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:48.823559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=332c683beb5e4b38bfdf5efceedc98fe)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:48.825583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:49.055149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332c683beb5e4b38bfdf5efceedc98fe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.129729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332c683beb5e4b38bfdf5efceedc98fe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.139024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332c683beb5e4b38bfdf5efceedc98fe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.139765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332c683beb5e4b38bfdf5efceedc98fe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.140376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b707ab0-972d-4c3a-a88e-ff66a1dceb1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332c683beb5e4b38bfdf5efceedc98fe'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.160573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 975/1948] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:48 2022] DELETE /identity/v3/users/332c683beb5e4b38bfdf5efceedc98fe => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:49.735066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:49.736742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:49.750916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a539-ad8b-47bc-a22f-0e0e0eaa0990 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:49.815398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:49.816012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:49.816302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:49.816580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] PATH_INFO: `/v3/projects/a8890d972c5649c78c1a8672a1b11d13` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:49.817829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8890d972c5649c78c1a8672a1b11d13)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:49.819745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:49.940590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8890d972c5649c78c1a8672a1b11d13', 'request_id': 'req-b267dacb-ad26-478e-824c-c1ffd127a62e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.949124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8890d972c5649c78c1a8672a1b11d13', 'request_id': 'req-b267dacb-ad26-478e-824c-c1ffd127a62e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:49.956619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8890d972c5649c78c1a8672a1b11d13', 'request_id': 'req-b267dacb-ad26-478e-824c-c1ffd127a62e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:50.034690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] The token cache is being invalidate because project a8890d972c5649c78c1a8672a1b11d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:50.034987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:50.035838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b267dacb-ad26-478e-824c-c1ffd127a62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:50.037479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 974/1949] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:49 2022] DELETE /identity/v3/projects/a8890d972c5649c78c1a8672a1b11d13 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:50.042926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.043443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.043703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.065709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:50.067772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:50.148972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 976/1950] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:50.157446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.158271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.158559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.181128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:50.182512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:50.191726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 975/1951] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:50.196066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.202486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:50.206780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d15f6d-4939-4473-ab63-dc27f8b460b2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.211497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:50.212131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.212473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.212787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.217914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:50.217914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:50.217914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:50.233594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 977/1952] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:50.235386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.244957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4d46-afe5-4104-8f4e-002984f13d30 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.249810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:50.250445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.250710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.250988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.251663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:50.253585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:50.357986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 976/1953] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:50 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:50.359473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.370994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8179-7cab-4c90-b29b-f7c20638442a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.430827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:50.434884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.434884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.434884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.434884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:50.434884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:50.507139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 978/1954] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:50 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:50.511470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.522955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb627d-45b3-4946-bb1b-bb7ea8a6ab55 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.528011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:50.528676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.529185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.529464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.530172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:50.538865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:50.549936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 977/1955] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:50.556926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.565826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe9e5-fc28-43af-a5e2-44f4ed4ae3e1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.579595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f37b3-57d3-4e22-9997-9b068166676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:50.581046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f37b3-57d3-4e22-9997-9b068166676a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.581709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f37b3-57d3-4e22-9997-9b068166676a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.582175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f37b3-57d3-4e22-9997-9b068166676a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.583085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f37b3-57d3-4e22-9997-9b068166676a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:50.585082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f37b3-57d3-4e22-9997-9b068166676a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:50.597724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 979/1956] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:50.604578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.630262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2cfa2-9d13-487b-aebe-99e13152db69 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.636974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:50.637921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.638548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.639124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] PATH_INFO: `/v3/projects/8b58379e5adc42f28998ddf052251e37/users/9f0d69f9d6ff480e82042f855698db57/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.662216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b58379e5adc42f28998ddf052251e37, user_id=9f0d69f9d6ff480e82042f855698db57, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:50.664984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:50.668502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:50.757736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 978/1957] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:50 2022] PUT /identity/v3/projects/8b58379e5adc42f28998ddf052251e37/users/9f0d69f9d6ff480e82042f855698db57/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:50.769521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:50.769811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:50.770091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:50.808627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] MFA Rules not processed for user `9f0d69f9d6ff480e82042f855698db57`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:50.809886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:50.875600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 980/1958] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:50.880137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:50.976172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ade68b-266b-4b2e-9349-21e1f7eb9f2f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:50.988838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.002829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.003135 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.003422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.004132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.008611 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:51.129270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 979/1959] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:50 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:51.133848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:51.148625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f5518-7b06-409b-a33b-8f56e621d1df None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:51.249191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.251496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.251790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.252073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.252885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.254927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:51.263284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:51.375936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 981/1960] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:51 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:51.385994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:51.397849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837662-481e-422f-9e7c-8ed7beeedc33 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:51.402750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.406539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.406539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.406539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.406539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.406539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:51.419204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 980/1961] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:51.423769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:51.438277 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5225-e395-4669-828b-3da064a5a971 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:51.441826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.442855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.443204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.443564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] PATH_INFO: `/v3/projects/ec0c2f7b94d74745a754b5a033f42e2d/users/675910c9b16048d9900346f0ea6b03f3/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.459991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0c2f7b94d74745a754b5a033f42e2d, user_id=675910c9b16048d9900346f0ea6b03f3, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.463044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:51.575314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 982/1962] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:51 2022] PUT /identity/v3/projects/ec0c2f7b94d74745a754b5a033f42e2d/users/675910c9b16048d9900346f0ea6b03f3/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:51.579255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:51.589246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0e668-24fb-4102-b694-48c73603c4b0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:51.653577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22317916-cfeb-4898-a89e-4f8ca90deb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.654340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22317916-cfeb-4898-a89e-4f8ca90deb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.654629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22317916-cfeb-4898-a89e-4f8ca90deb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.654911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22317916-cfeb-4898-a89e-4f8ca90deb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.656673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22317916-cfeb-4898-a89e-4f8ca90deb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.658078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22317916-cfeb-4898-a89e-4f8ca90deb4d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:51.669096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 981/1963] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:51.672991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:51.685346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64434f-2f2a-4142-a1c3-ff2293980545 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:51.694065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.694065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.694283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.694620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] PATH_INFO: `/v3/projects/ec0c2f7b94d74745a754b5a033f42e2d/users/675910c9b16048d9900346f0ea6b03f3/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.697881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0c2f7b94d74745a754b5a033f42e2d, user_id=675910c9b16048d9900346f0ea6b03f3, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.699723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:51.712324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 983/1964] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:51 2022] PUT /identity/v3/projects/ec0c2f7b94d74745a754b5a033f42e2d/users/675910c9b16048d9900346f0ea6b03f3/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:51.722944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e39b2-edf5-4ce4-b206-4da516f3676f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.723311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e39b2-edf5-4ce4-b206-4da516f3676f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.723704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e39b2-edf5-4ce4-b206-4da516f3676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.755942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-973e39b2-edf5-4ce4-b206-4da516f3676f None None] MFA Rules not processed for user `675910c9b16048d9900346f0ea6b03f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:51.757686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-973e39b2-edf5-4ce4-b206-4da516f3676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:51.840965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:51.873990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 982/1965] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:51.885887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:51.887777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:51.975743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05320010-aed4-4505-b0e6-440917dbf1b5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:51.979979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eb5a1-ee3b-42d3-9d54-f58b1bfbb2e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:51.980765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eb5a1-ee3b-42d3-9d54-f58b1bfbb2e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:51.981191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eb5a1-ee3b-42d3-9d54-f58b1bfbb2e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:51.981471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eb5a1-ee3b-42d3-9d54-f58b1bfbb2e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:51.992669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eb5a1-ee3b-42d3-9d54-f58b1bfbb2e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:51.994301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eb5a1-ee3b-42d3-9d54-f58b1bfbb2e7 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:52.009439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 984/1966] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:52.638078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9873-228d-407a-9979-b9d3447308dc None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:52.638594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9873-228d-407a-9979-b9d3447308dc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:52.640799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9873-228d-407a-9979-b9d3447308dc None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:52.640799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 983/1967] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:40:52.680044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:52.680889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:52.681361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:52.708705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:52.709306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:52.710122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9873-228d-407a-9979-b9d3447308dc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:52.787562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 985/1968] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:52.795045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9873-228d-407a-9979-b9d3447308dc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:52.799809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:52.800597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:52.801272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:52.801562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:52.801839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] PATH_INFO: `/v3/users/9f0d69f9d6ff480e82042f855698db57` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:52.802503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:52.803061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0d69f9d6ff480e82042f855698db57)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:52.805025 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:52.819656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620329-294a-4569-89a8-0103a42f2b74 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:52.825467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:52.826089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:52.826399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:52.826645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:52.836236 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:52.838245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:52.851265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 986/1969] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:52.852402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:52.853856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:52.868603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72193855-0c3f-4ebe-b9e1-057febedd6ef service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:52.874637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:52.875537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:52.875819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:52.876089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] PATH_INFO: `/v3/users/8737247b374f45338fa9370dac461835` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:52.877299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8737247b374f45338fa9370dac461835)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:52.879217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:53.037429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0d69f9d6ff480e82042f855698db57'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.038086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0d69f9d6ff480e82042f855698db57'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.045101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0d69f9d6ff480e82042f855698db57'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.059315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0d69f9d6ff480e82042f855698db57'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.061010 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ce8c197f-2116-4b0a-8ca8-30a6b1b0a7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0d69f9d6ff480e82042f855698db57'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.085646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:53.099870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8737247b374f45338fa9370dac461835'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.206630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 984/1970] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:52 2022] DELETE /identity/v3/users/9f0d69f9d6ff480e82042f855698db57 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:53.209053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:53.209344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:53.209626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:53.238426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:53.239852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:53.286043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8737247b374f45338fa9370dac461835'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.293742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8737247b374f45338fa9370dac461835'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.294628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8737247b374f45338fa9370dac461835'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.295448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8737247b374f45338fa9370dac461835'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.307031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 985/1971] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:53.317467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 987/1972] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:52 2022] DELETE /identity/v3/users/8737247b374f45338fa9370dac461835 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:53.320272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:53.320272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:53.351865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:53.402851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c88cc-57b2-4779-b08a-3b0ae83459d5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:53.459745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f6cd2-865c-4ff3-808d-7fc81e249358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:53.460293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f6cd2-865c-4ff3-808d-7fc81e249358 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:53.460575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f6cd2-865c-4ff3-808d-7fc81e249358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:53.460881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f6cd2-865c-4ff3-808d-7fc81e249358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:53.536602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f6cd2-865c-4ff3-808d-7fc81e249358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:53.538060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f6cd2-865c-4ff3-808d-7fc81e249358 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:53.547688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 986/1973] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:53.589314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:53.591070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:53.606659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6e85a-f1d8-40c4-9058-a3e0c7704154 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:53.612477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:53.613187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:53.613533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:53.614377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] PATH_INFO: `/v3/projects/10495cdea53e459288d1949eb788d86b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:53.615651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10495cdea53e459288d1949eb788d86b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:53.618007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:53.761957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10495cdea53e459288d1949eb788d86b', 'request_id': 'req-5488f3e1-8ad0-47dd-b8b4-53d48997653d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.778316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10495cdea53e459288d1949eb788d86b', 'request_id': 'req-5488f3e1-8ad0-47dd-b8b4-53d48997653d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.784942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10495cdea53e459288d1949eb788d86b', 'request_id': 'req-5488f3e1-8ad0-47dd-b8b4-53d48997653d'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.934798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] The token cache is being invalidate because project 10495cdea53e459288d1949eb788d86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:53.935255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.936308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-5488f3e1-8ad0-47dd-b8b4-53d48997653d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:53.937937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 988/1974] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:53 2022] DELETE /identity/v3/projects/10495cdea53e459288d1949eb788d86b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:53.942803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:53.943105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:53.943388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:53.964108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:53.965300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.033821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 987/1975] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:54.041954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.042245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.042540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.063773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:54.065012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.072999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 989/1976] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:54.077105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.087081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c241-9474-4ba0-92f6-0a24ad8bc15f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.093074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.095330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.095591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.096288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.096569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.096883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.097588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:54.097897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.099492 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.108428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54687cc-c7e9-424e-8305-d6e4c86152d2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.116252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 988/1977] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:40:54.116416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.116416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.116416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.116416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] PATH_INFO: `/v3/projects/8b58379e5adc42f28998ddf052251e37` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.117393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.117504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b58379e5adc42f28998ddf052251e37)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.119656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.128437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e0723-ef8b-4ef7-aec2-fd9e19015514 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.135108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.135757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.142543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.142543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.142543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.142543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.229622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b58379e5adc42f28998ddf052251e37', 'request_id': 'req-bce66732-9b58-4e2d-b149-a56d1278f8c5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.235851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b58379e5adc42f28998ddf052251e37', 'request_id': 'req-bce66732-9b58-4e2d-b149-a56d1278f8c5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.242178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b58379e5adc42f28998ddf052251e37', 'request_id': 'req-bce66732-9b58-4e2d-b149-a56d1278f8c5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.247684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 989/1978] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:54 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:54.252366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.317926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988672a-6279-4e1c-9a2e-2e43a4b060ff admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.322584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.323206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.323495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.323775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.324533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.326487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.342457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] The token cache is being invalidate because project 8b58379e5adc42f28998ddf052251e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:54.342745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.343405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.345083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 990/1979] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:54 2022] DELETE /identity/v3/projects/8b58379e5adc42f28998ddf052251e37 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:54.349094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.350358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.361417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:54.413920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce66732-9b58-4e2d-b149-a56d1278f8c5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.419105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.419710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:54.419840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.420055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.420336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] PATH_INFO: `/v3/users/675910c9b16048d9900346f0ea6b03f3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.421790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=675910c9b16048d9900346f0ea6b03f3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.423789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.426382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 990/1980] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:54 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:54.430228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.431924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.447672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516272c-4d9c-4e51-88c3-9edfe2649396 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.453545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.454177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.454472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.454775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.455500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.457240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.467696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 991/1981] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:54.471600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.481376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db4980-fba0-40fa-9abc-60789ddf2589 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.486174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.486761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.487065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.491471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.491471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.491471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.500700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 992/1982] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:40:54.504861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.514984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e01d3-fdfd-477d-b541-59fe8f9268a8 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.520462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0186f5-2c19-4e9d-9851-e9d024d9855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.521171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0186f5-2c19-4e9d-9851-e9d024d9855a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.521660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0186f5-2c19-4e9d-9851-e9d024d9855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.524986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0186f5-2c19-4e9d-9851-e9d024d9855a admin admin] PATH_INFO: `/v3/projects/02e8cb02305f4d6b8e12080c7e573bd8/users/afcf63c9b8c64c73a3772490d5b5e0d7/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.537472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0186f5-2c19-4e9d-9851-e9d024d9855a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e8cb02305f4d6b8e12080c7e573bd8, user_id=afcf63c9b8c64c73a3772490d5b5e0d7, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.540092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0186f5-2c19-4e9d-9851-e9d024d9855a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.584016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675910c9b16048d9900346f0ea6b03f3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.620077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 993/1983] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:54 2022] PUT /identity/v3/projects/02e8cb02305f4d6b8e12080c7e573bd8/users/afcf63c9b8c64c73a3772490d5b5e0d7/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:54.630375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.630660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.630935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.653964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675910c9b16048d9900346f0ea6b03f3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.659263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] MFA Rules not processed for user `afcf63c9b8c64c73a3772490d5b5e0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:54.661121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.662410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675910c9b16048d9900346f0ea6b03f3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.663076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675910c9b16048d9900346f0ea6b03f3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.663712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675910c9b16048d9900346f0ea6b03f3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:54.682804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 991/1984] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:54 2022] DELETE /identity/v3/users/675910c9b16048d9900346f0ea6b03f3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:54.731072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 994/1985] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:54.742146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:54.743561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:54.821978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c8b3-13d3-4309-b1f5-e454bc77bb7d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:54.828482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:54.833535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:54.833535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:54.833535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:54.856341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:54.894628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:54.896249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:54.905524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 992/1986] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:55.198974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:55.200145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:55.218318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:55.220720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:55.225791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:55.298937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5126-3e89-4155-ba31-4866d1199846 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:55.301416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e8d38-853c-4807-b7fd-3ea5fe57bd0d service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:55.306090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:55.306752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.307036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.307311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] PATH_INFO: `/v3/projects/ec0c2f7b94d74745a754b5a033f42e2d` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.307416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:55.307974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.308341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.308514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0c2f7b94d74745a754b5a033f42e2d)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:55.309274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] PATH_INFO: `/v3/users/afcf63c9b8c64c73a3772490d5b5e0d7` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.313506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afcf63c9b8c64c73a3772490d5b5e0d7)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:55.313692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:55.313790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:55.511609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afcf63c9b8c64c73a3772490d5b5e0d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.512338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afcf63c9b8c64c73a3772490d5b5e0d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.516798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0c2f7b94d74745a754b5a033f42e2d', 'request_id': 'req-19152c52-a8a6-48e5-a889-807bbfdc7964'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.520981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afcf63c9b8c64c73a3772490d5b5e0d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.527274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0c2f7b94d74745a754b5a033f42e2d', 'request_id': 'req-19152c52-a8a6-48e5-a889-807bbfdc7964'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.530287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0c2f7b94d74745a754b5a033f42e2d', 'request_id': 'req-19152c52-a8a6-48e5-a889-807bbfdc7964'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.534202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afcf63c9b8c64c73a3772490d5b5e0d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.535127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-9629a0f3-a1d7-4f3b-8cdd-c480a82b59e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afcf63c9b8c64c73a3772490d5b5e0d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.591183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] The token cache is being invalidate because project ec0c2f7b94d74745a754b5a033f42e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:55.591466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.592082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-19152c52-a8a6-48e5-a889-807bbfdc7964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:55.593878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 993/1987] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:55 2022] DELETE /identity/v3/projects/ec0c2f7b94d74745a754b5a033f42e2d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:55.598545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e10b-3dfb-4bb5-86ad-1eb706831467 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.598832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e10b-3dfb-4bb5-86ad-1eb706831467 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.599106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e10b-3dfb-4bb5-86ad-1eb706831467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.618744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ac15e10b-3dfb-4bb5-86ad-1eb706831467 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:55.619935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ac15e10b-3dfb-4bb5-86ad-1eb706831467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:55.666579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:55.676665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 995/1988] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:55 2022] DELETE /identity/v3/users/afcf63c9b8c64c73a3772490d5b5e0d7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:55.681082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.681377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.681664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.681789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 994/1989] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:55.690165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.690459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.690742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.701672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:55.702955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:55.711710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:55.713031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:55.770043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 996/1990] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:55.778948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 995/1991] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:55.780092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:55.782155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:55.783732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:55.793657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7d78-1b68-4bdd-9b27-068c172bf4c5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:55.798877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:55.800921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.800921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.800921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.800921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:55.801198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:55.802655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:55.814281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 996/1992] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:40:55.820021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:55.823684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:55.831665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca18270-eb17-4455-8a34-acaab565a18d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:55.837604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:55.838227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.838513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.838909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.839581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:55.841557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:55.843829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18536f1-f73d-4661-ba09-b4f9377ff325 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:55.847571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:55.848469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:55.848469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:55.848769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:55.861893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:55.863408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:55.873883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 997/1993] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:55.950004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 997/1994] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:55 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:55.954139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:55.963922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd9330-b148-49e4-b526-a499239419e0 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.018227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.018849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.019353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.019900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.021088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.023017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.107721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 998/1995] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:55 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:56.110544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.123069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39600ee-7654-405e-8aa8-d7979f3300cb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.130465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.131227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.131614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.132051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.132890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.134554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.149947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 998/1996] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:56.154151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.166551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789bf0e-2627-4f76-bd44-b10e7e6bd842 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.173210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a16d6-ce23-46d8-a53d-18b89b0a4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.173927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a16d6-ce23-46d8-a53d-18b89b0a4a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.174212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a16d6-ce23-46d8-a53d-18b89b0a4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.174489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a16d6-ce23-46d8-a53d-18b89b0a4a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.175199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a16d6-ce23-46d8-a53d-18b89b0a4a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.176874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a16d6-ce23-46d8-a53d-18b89b0a4a2e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.189427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 999/1997] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:56.196719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.220154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f66b66-4214-498b-bb94-b293afe9b189 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.223188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.223871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.224154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.224429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] PATH_INFO: `/v3/projects/4b3fca404cf64c05b85422e136247cf5/users/8a8ad8d1f0414e0c88dc1af2e6bcef72/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.242740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3fca404cf64c05b85422e136247cf5, user_id=8a8ad8d1f0414e0c88dc1af2e6bcef72, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.245552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.350113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 999/1998] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:56 2022] PUT /identity/v3/projects/4b3fca404cf64c05b85422e136247cf5/users/8a8ad8d1f0414e0c88dc1af2e6bcef72/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:56.360243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.360713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.360947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.390470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] MFA Rules not processed for user `8a8ad8d1f0414e0c88dc1af2e6bcef72`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:56.391649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:56.401826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.405210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:56.477734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1000/1999] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:56.479658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab0b84-500f-4f79-8a69-af6c395942d6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.485659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.486338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.486624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.486907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] PATH_INFO: `/v3/projects/02e8cb02305f4d6b8e12080c7e573bd8` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.488087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e8cb02305f4d6b8e12080c7e573bd8)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.489696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.490315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.491039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:56.547999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:56.553444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fc9c4-909c-489b-81c6-5ded6eb11adb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.557251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.557877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.558163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.561720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.567073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.568496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.577327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1001/2000] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:56.600388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.612120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5a61-d9b9-4458-a486-c5616962aab8 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.616941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.617580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.617864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.618143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] PATH_INFO: `/v3/users/8a8ad8d1f0414e0c88dc1af2e6bcef72` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.619327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8ad8d1f0414e0c88dc1af2e6bcef72)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.620663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:56.621272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.635402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e8cb02305f4d6b8e12080c7e573bd8', 'request_id': 'req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.643214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e8cb02305f4d6b8e12080c7e573bd8', 'request_id': 'req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.649235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e8cb02305f4d6b8e12080c7e573bd8', 'request_id': 'req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.742856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] The token cache is being invalidate because project 02e8cb02305f4d6b8e12080c7e573bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:56.743153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.743818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4c9c4f81-d8e1-44b3-b577-c6ca2429a338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.745393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1000/2001] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:56 2022] DELETE /identity/v3/projects/02e8cb02305f4d6b8e12080c7e573bd8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:56.750019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30084e75-44d9-4959-9e82-9734257d1958 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.750304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30084e75-44d9-4959-9e82-9734257d1958 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.750584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30084e75-44d9-4959-9e82-9734257d1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.769948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-30084e75-44d9-4959-9e82-9734257d1958 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:56.771152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-30084e75-44d9-4959-9e82-9734257d1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:56.808618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8ad8d1f0414e0c88dc1af2e6bcef72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.809253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8ad8d1f0414e0c88dc1af2e6bcef72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.817214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8ad8d1f0414e0c88dc1af2e6bcef72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.830646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8ad8d1f0414e0c88dc1af2e6bcef72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.831368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e319983-0696-4b08-904e-ca376558f163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8ad8d1f0414e0c88dc1af2e6bcef72'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:56.839817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1001/2002] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:56.841513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.841833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.842111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.863673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:56.864909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:56.872992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1002/2003] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:56.877401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.886283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac62c-b926-4dd3-af0d-e238142b39f2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.890853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.892000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.892510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.892976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.893697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:40:56.893966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.895612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.907067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1003/2004] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:40:56.912039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:56.921297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fad3e-978f-49ab-98fe-2cd64885e302 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:56.926055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:56.926628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.926906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.927176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.927818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:56.929718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:56.939966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1002/2005] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:40:56 2022] DELETE /identity/v3/users/8a8ad8d1f0414e0c88dc1af2e6bcef72 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:56.944419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:56.944853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:56.945206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:56.964607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:56.965864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:57.024389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1003/2006] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:40:57.034194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.036122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:57.045187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1004/2007] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:56 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:57.050054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.102532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a1f17-eb6b-4d12-86cc-ad9c0a43260b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.118632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:57.120095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bceb25-466d-4d91-83e7-5e65929761b4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.131129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.131759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.134972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.134972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.134972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.135182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.159730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.160361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.160708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.161014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.170579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.172055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.183400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1004/2008] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:40:57.242262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1005/2009] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:57 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:57.246435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.257542 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02f880-eb91-4f76-bc97-7b4d498f389c service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.262772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.263403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.263691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.267490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.267490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.267490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.277537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1005/2010] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:57.281935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.289551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:57.293729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3a07-5bfd-42e0-8991-8b7ba5ad604f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.299575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aadc4f-4d7f-4680-bdf4-e7eaca5c45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.300225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aadc4f-4d7f-4680-bdf4-e7eaca5c45de admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.300510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aadc4f-4d7f-4680-bdf4-e7eaca5c45de admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.300817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aadc4f-4d7f-4680-bdf4-e7eaca5c45de admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.301610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aadc4f-4d7f-4680-bdf4-e7eaca5c45de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.303221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aadc4f-4d7f-4680-bdf4-e7eaca5c45de admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.314631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1006/2011] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:57.318902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.345830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd022d-886b-4eba-8020-f96527a6ed25 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.351057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.352164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.352453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.352873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] PATH_INFO: `/v3/projects/8bcd26ad03744bb8a9af74f0746f2afe/users/515a335d60c04befa0d485e38e710ddd/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.385032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcd26ad03744bb8a9af74f0746f2afe, user_id=515a335d60c04befa0d485e38e710ddd, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.388933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.481993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1006/2012] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:57 2022] PUT /identity/v3/projects/8bcd26ad03744bb8a9af74f0746f2afe/users/515a335d60c04befa0d485e38e710ddd/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:57.493821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.494108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.494379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.536362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] MFA Rules not processed for user `515a335d60c04befa0d485e38e710ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:57.538791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:57.616660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1007/2013] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:57.617876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.670186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.675089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:57.692633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e18ecf-819f-4cac-8b66-08f9d876cf66 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.697828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.698454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.698738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.699710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.700238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.702422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.747802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689c9a-0ef2-4303-9e6e-bef8735b047d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.753403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.754146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.754433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.754694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] PATH_INFO: `/v3/projects/4b3fca404cf64c05b85422e136247cf5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.755842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3fca404cf64c05b85422e136247cf5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.757866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:57.824450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1007/2014] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:40:57.828600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:57.893310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a9fd5-a14e-49aa-ba37-4bdc7ce7d38b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:57.893639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3fca404cf64c05b85422e136247cf5', 'request_id': 'req-995af621-0583-4231-a9b6-55fd4137a112'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:57.900468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3fca404cf64c05b85422e136247cf5', 'request_id': 'req-995af621-0583-4231-a9b6-55fd4137a112'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:57.908499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3fca404cf64c05b85422e136247cf5', 'request_id': 'req-995af621-0583-4231-a9b6-55fd4137a112'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:57.914400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:57.958582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:57.959203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:57.959488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:57.959765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:57.960429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:57.962383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.014076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] The token cache is being invalidate because project 4b3fca404cf64c05b85422e136247cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:40:58.014365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:58.017412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:40:58.017412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1008/2015] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:40:57 2022] DELETE /identity/v3/projects/4b3fca404cf64c05b85422e136247cf5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:58.071926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1008/2016] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:40:57 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:40:58.077024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:58.078867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:58.098902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995af621-0583-4231-a9b6-55fd4137a112 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:58.104317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:58.105000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.105285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.105564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.106494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:58.108153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.120773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1009/2017] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:58.125039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:58.136024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3a5c5-ecc8-4dff-aa8e-e5cda40a1917 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:58.141030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:58.141889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.142179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.142462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] PATH_INFO: `/v3/projects/3d72cb5ca7aa4296961a140b6bf8fa10/users/abd7ee4defab4ddf94dbb67b4d5540ef/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.161043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d72cb5ca7aa4296961a140b6bf8fa10, user_id=abd7ee4defab4ddf94dbb67b4d5540ef, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:58.163921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.254398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1009/2018] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:58 2022] PUT /identity/v3/projects/3d72cb5ca7aa4296961a140b6bf8fa10/users/abd7ee4defab4ddf94dbb67b4d5540ef/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:40:58.258373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:58.263487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:58.268738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add79-10e2-4f76-a09b-2a8c8ca05502 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:58.325354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603e44a-cdbf-4562-a622-60d9d5a8764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:58.325971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e44a-cdbf-4562-a622-60d9d5a8764c admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.326263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e44a-cdbf-4562-a622-60d9d5a8764c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.326535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e44a-cdbf-4562-a622-60d9d5a8764c admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.327286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603e44a-cdbf-4562-a622-60d9d5a8764c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:58.329047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603e44a-cdbf-4562-a622-60d9d5a8764c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.339238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1010/2019] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:40:58.343066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:58.356094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7bffa-aef5-4d89-b8e9-9267ad7df36f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:58.361476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:58.362134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.362416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.362691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] PATH_INFO: `/v3/projects/3d72cb5ca7aa4296961a140b6bf8fa10/users/abd7ee4defab4ddf94dbb67b4d5540ef/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.364619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d72cb5ca7aa4296961a140b6bf8fa10, user_id=abd7ee4defab4ddf94dbb67b4d5540ef, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:58.367264 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.377834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1010/2020] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:40:58 2022] PUT /identity/v3/projects/3d72cb5ca7aa4296961a140b6bf8fa10/users/abd7ee4defab4ddf94dbb67b4d5540ef/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:40:58.387925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.388211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.388487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.417375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] MFA Rules not processed for user `abd7ee4defab4ddf94dbb67b4d5540ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:40:58.418570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:58.485429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1011/2021] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:40:58.499809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:58.501295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:58.571036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6206e-226d-48bb-a7d7-886f4e02d19e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:58.575672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3604a-6f38-4b6b-b8fe-83b0aa12a116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:58.576295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3604a-6f38-4b6b-b8fe-83b0aa12a116 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.576580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3604a-6f38-4b6b-b8fe-83b0aa12a116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.576895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3604a-6f38-4b6b-b8fe-83b0aa12a116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.586828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3604a-6f38-4b6b-b8fe-83b0aa12a116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:58.588257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3604a-6f38-4b6b-b8fe-83b0aa12a116 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.598738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1011/2022] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:40:58.784606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:40:58.794480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac481b-5f63-41e5-87be-f0a5b23235c6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:40:58.798165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:40:58.798863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:40:58.799208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:40:58.799553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:40:58.801382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:40:58.870546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:40:58.872135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:40:58.882127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1012/2023] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:40:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:41:02.785011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabb23-f46f-4aee-85f4-b7f6184bdcd8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:02.786177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabb23-f46f-4aee-85f4-b7f6184bdcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:02.786177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabb23-f46f-4aee-85f4-b7f6184bdcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:02.804712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7ddabb23-f46f-4aee-85f4-b7f6184bdcd8 None None] MFA Rules not processed for user `c485837e09c946f3b391e2bf6ae88322`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:02.809116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7ddabb23-f46f-4aee-85f4-b7f6184bdcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:02.861702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1012/2024] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:03.324430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:03.325898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:03.355420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:03.395034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa5dc6-e8f5-49c6-96a9-8b78f0a154bf service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:03.399586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:03.400230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:03.400513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:03.400818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] PATH_INFO: `/v3/users/f41c39884dc94f5ba9281519ceca5eb9` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:03.402007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41c39884dc94f5ba9281519ceca5eb9)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:03.403979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:03.639802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41c39884dc94f5ba9281519ceca5eb9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:03.710421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41c39884dc94f5ba9281519ceca5eb9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:03.717815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41c39884dc94f5ba9281519ceca5eb9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:03.718442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41c39884dc94f5ba9281519ceca5eb9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:03.719044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41c39884dc94f5ba9281519ceca5eb9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:03.737237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1013/2025] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:03 2022] DELETE /identity/v3/users/f41c39884dc94f5ba9281519ceca5eb9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:03.741769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:03.742058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:03.743612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:03.761091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:03.762296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:03.774406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:03.821847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1013/2026] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:03.832248 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:03.833670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:03.893184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cba1ff-5bca-4326-bba1-ca6db0d359d0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:03.896786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3cbdd-8488-45f9-9c35-c7b19a06667f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:03.897433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cbdd-8488-45f9-9c35-c7b19a06667f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:03.897713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cbdd-8488-45f9-9c35-c7b19a06667f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:03.898998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cbdd-8488-45f9-9c35-c7b19a06667f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:03.908607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3cbdd-8488-45f9-9c35-c7b19a06667f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:03.910058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3cbdd-8488-45f9-9c35-c7b19a06667f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:03.919377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1014/2027] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:04.336201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:04.337666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:04.369681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a1b9-a12d-42d6-9a48-c8d71e05eaac None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:04.375065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:04.376239 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:04.376635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:04.376823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] PATH_INFO: `/v3/projects/c410efb39cc64c71b3d35c8a77efa78b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:04.378070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c410efb39cc64c71b3d35c8a77efa78b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:04.380056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:04.502423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c410efb39cc64c71b3d35c8a77efa78b', 'request_id': 'req-38e5074b-37ce-4aef-b89b-c03fbe917ff4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:04.509094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c410efb39cc64c71b3d35c8a77efa78b', 'request_id': 'req-38e5074b-37ce-4aef-b89b-c03fbe917ff4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:04.515619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c410efb39cc64c71b3d35c8a77efa78b', 'request_id': 'req-38e5074b-37ce-4aef-b89b-c03fbe917ff4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:04.632580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] The token cache is being invalidate because project c410efb39cc64c71b3d35c8a77efa78b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:04.633142 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:04.634238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-38e5074b-37ce-4aef-b89b-c03fbe917ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:04.640488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1014/2028] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:04 2022] DELETE /identity/v3/projects/c410efb39cc64c71b3d35c8a77efa78b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:04.642076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:04.642525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:04.642724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:04.680175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:04.681457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:04.730008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:04.750310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1015/2029] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:41:04.759241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:04.759536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:04.759818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:04.779902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:04.781179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:04.790335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1015/2030] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:04.794656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:04.805329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af33e0-0f13-4288-b4da-0cf3d3d851c3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:04.809917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:04.810522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:04.810804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:04.811081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:04.811771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:41:04.812101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:04.813913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:04.827818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1016/2031] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:41:04.832267 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:04.841598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733653-e300-43eb-bcc4-e82fd56b4984 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:04.846946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:04.847569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:04.847851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:04.848143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:04.848880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:04.850850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:04.957312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1016/2032] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:04 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:04.961346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:04.973990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d653-e8f9-46ec-8e6b-31fc7963d737 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:05.035976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:05.036609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:05.036931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:05.037210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:05.037891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:05.039835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:05.131522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1017/2033] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:04 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:05.135781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:05.147046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dc042-bfb4-400c-974b-251a45634c79 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:05.151956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:05.152994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:05.158461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:05.158461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:05.158461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:05.158461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:05.167865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1017/2034] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:05.172075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:05.182336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201698a2-c57e-429b-a12a-21da889ccdb0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:05.186934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c7c50-b769-43c3-9dee-3fdb4bd607d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:05.187540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7c50-b769-43c3-9dee-3fdb4bd607d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:05.187878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7c50-b769-43c3-9dee-3fdb4bd607d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:05.189676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c7c50-b769-43c3-9dee-3fdb4bd607d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:05.189676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c7c50-b769-43c3-9dee-3fdb4bd607d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:05.190519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c7c50-b769-43c3-9dee-3fdb4bd607d3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:05.201006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1018/2035] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:05.206032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:05.216304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14c4f-fe5c-426c-8108-27b488a0be93 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:05.221854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:05.222514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:05.222802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:05.223085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] PATH_INFO: `/v3/projects/c4fa09373cd549be8feb8bc2caabd81e/users/5a66a3b4163545c2906ec1b1b58b0c48/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:05.238617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fa09373cd549be8feb8bc2caabd81e, user_id=5a66a3b4163545c2906ec1b1b58b0c48, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:05.241457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:05.334272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1018/2036] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:05 2022] PUT /identity/v3/projects/c4fa09373cd549be8feb8bc2caabd81e/users/5a66a3b4163545c2906ec1b1b58b0c48/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:05.345771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:05.346064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:05.346347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:05.375448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] MFA Rules not processed for user `5a66a3b4163545c2906ec1b1b58b0c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:05.376767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:05.443720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1019/2037] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:05.458979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:05.460703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:05.511949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:05.529871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df366b0-3942-4940-910b-48849d29fc69 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:05.532432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed8f79-c816-44e7-bc07-f104f7400c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:05.533102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed8f79-c816-44e7-bc07-f104f7400c0f service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:05.533390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed8f79-c816-44e7-bc07-f104f7400c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:05.533669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed8f79-c816-44e7-bc07-f104f7400c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:05.542382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed8f79-c816-44e7-bc07-f104f7400c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:05.543820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed8f79-c816-44e7-bc07-f104f7400c0f service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:05.553510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1019/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:15.440454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:16.145081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:20.590733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:20.653660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d322b5-9b46-4e9b-91ad-0186faea9707 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:20.658542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:20.659255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:20.659497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:20.659774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] PATH_INFO: `/v3/users/5a66a3b4163545c2906ec1b1b58b0c48` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:20.661039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a66a3b4163545c2906ec1b1b58b0c48)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:20.663001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:20.882319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a66a3b4163545c2906ec1b1b58b0c48'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:20.964525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a66a3b4163545c2906ec1b1b58b0c48'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:20.971953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a66a3b4163545c2906ec1b1b58b0c48'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:20.972937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a66a3b4163545c2906ec1b1b58b0c48'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:20.973285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a66a3b4163545c2906ec1b1b58b0c48'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:20.991384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1020/2039] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:20 2022] DELETE /identity/v3/users/5a66a3b4163545c2906ec1b1b58b0c48 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:20.996899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:20.997402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:20.997502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:21.017449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:21.018924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:21.078391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1020/2040] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:21.088518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:21.090667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:21.149983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b162c-90af-488a-8c0e-4aec85504ded admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:21.153561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77c1d4-1134-4b60-8aa4-7afb873ce6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:21.154184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77c1d4-1134-4b60-8aa4-7afb873ce6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:21.154468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77c1d4-1134-4b60-8aa4-7afb873ce6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:21.154746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77c1d4-1134-4b60-8aa4-7afb873ce6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:21.164581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77c1d4-1134-4b60-8aa4-7afb873ce6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:21.166097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77c1d4-1134-4b60-8aa4-7afb873ce6a6 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:21.176234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1021/2041] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:21.734348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:21.740126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:21.748612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d1bc-b203-42d0-9937-91bac755de12 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:21.754006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:21.754655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:21.754933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:21.755209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] PATH_INFO: `/v3/projects/c4fa09373cd549be8feb8bc2caabd81e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:21.756749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fa09373cd549be8feb8bc2caabd81e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:21.758850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:21.862562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fa09373cd549be8feb8bc2caabd81e', 'request_id': 'req-b8485c5d-42b3-479b-846e-3fc929fffbe8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:21.869240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fa09373cd549be8feb8bc2caabd81e', 'request_id': 'req-b8485c5d-42b3-479b-846e-3fc929fffbe8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:21.875021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fa09373cd549be8feb8bc2caabd81e', 'request_id': 'req-b8485c5d-42b3-479b-846e-3fc929fffbe8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:21.973725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] The token cache is being invalidate because project c4fa09373cd549be8feb8bc2caabd81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:21.973924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:21.974598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b8485c5d-42b3-479b-846e-3fc929fffbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:21.976389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1021/2042] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:21 2022] DELETE /identity/v3/projects/c4fa09373cd549be8feb8bc2caabd81e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:21.981309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:21.981836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:21.981948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.001922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:22.003474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:22.020625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:22.064550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1022/2043] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:41:22.073574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.074116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.074116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.096212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:22.097767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:22.107041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1022/2044] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:22.111275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.121678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b832b-e244-42b8-b50b-b4c8a1f95113 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.126253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.126863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.127336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.127676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.128381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:41:22.128816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.130420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.141885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1023/2045] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:41:22.146214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.155760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6947-632e-4606-8809-88c4417fe40c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.161262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.161927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.162218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.162521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.163232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.165561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.270114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1023/2046] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:22 2022] POST /identity/v3/projects => generated 361 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:22.274364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.285457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac78d1-3aea-4953-8eea-ff29faeeac23 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.351071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.351700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.351983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.352262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.352972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.354961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.470718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1024/2047] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:22 2022] POST /identity/v3/users => generated 281 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:22.477119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.487497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b9228-5a15-405e-afae-d5b072866656 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.492776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.493465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.493753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.494067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.494855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.496877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.511817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1024/2048] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:22.512851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.527456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8263776-f690-4398-818b-515056c38c02 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.532690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b13009-10e9-46b9-bdbb-6d3ca685896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.534354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b13009-10e9-46b9-bdbb-6d3ca685896a admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.534550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b13009-10e9-46b9-bdbb-6d3ca685896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.534935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b13009-10e9-46b9-bdbb-6d3ca685896a admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.535704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b13009-10e9-46b9-bdbb-6d3ca685896a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.537675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b13009-10e9-46b9-bdbb-6d3ca685896a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.565236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.565448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1025/2049] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:22.570449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66126e0-0d0d-4bf7-ab05-7b99ab929d22 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.576158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.577036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.578790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.578790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] PATH_INFO: `/v3/projects/27ed9bc12bac44de88c5163af8a1c36c/users/a80cb9c13faf4b79a0861a8b250e0a22/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.594268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ed9bc12bac44de88c5163af8a1c36c, user_id=a80cb9c13faf4b79a0861a8b250e0a22, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.597811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.685518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1025/2050] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:22 2022] PUT /identity/v3/projects/27ed9bc12bac44de88c5163af8a1c36c/users/a80cb9c13faf4b79a0861a8b250e0a22/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:22.697127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346930-03e8-4554-adf8-3ef020bd8c30 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.697776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346930-03e8-4554-adf8-3ef020bd8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.698122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346930-03e8-4554-adf8-3ef020bd8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.729833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e1346930-03e8-4554-adf8-3ef020bd8c30 None None] MFA Rules not processed for user `a80cb9c13faf4b79a0861a8b250e0a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:22.731058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e1346930-03e8-4554-adf8-3ef020bd8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:22.816152 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1026/2051] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:22.827289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:22.829096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:22.852117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:22.886575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4563a-bf82-459d-af18-c69f47d2ef8a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:22.890549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:22.891169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:22.891474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:22.891750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:22.902817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:22.904298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:22.914397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1026/2052] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:24.553830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:24.554307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:24.554396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:24.575033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:24.575033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:24.587432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:24.635172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1027/2053] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:24.687585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:24.689113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:24.766415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9abcb0-0093-42e7-b1b1-26c9e4643914 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:24.772180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded9a96-a807-4158-b429-4597557cebe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:24.772821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9a96-a807-4158-b429-4597557cebe6 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:24.773104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9a96-a807-4158-b429-4597557cebe6 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:24.775353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9a96-a807-4158-b429-4597557cebe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:24.781924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9a96-a807-4158-b429-4597557cebe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:24.784192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded9a96-a807-4158-b429-4597557cebe6 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:24.793422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1027/2054] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:41:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:41:34.736653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=17 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:34.793173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=49 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:39.434602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:39.436180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:39.526829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7bdf-ad44-4999-bb75-96da5fa1bfa4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:39.534418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:39.535586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:39.535586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:39.536183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] PATH_INFO: `/v3/users/515a335d60c04befa0d485e38e710ddd` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:39.537612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515a335d60c04befa0d485e38e710ddd)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:39.539838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:39.779877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515a335d60c04befa0d485e38e710ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:39.936535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515a335d60c04befa0d485e38e710ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:39.948048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515a335d60c04befa0d485e38e710ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:39.950033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515a335d60c04befa0d485e38e710ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:39.953921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515a335d60c04befa0d485e38e710ddd'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:40.029102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:40.030071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:40.030527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:40.030883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1028/2055] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:39 2022] DELETE /identity/v3/users/515a335d60c04befa0d485e38e710ddd => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:40.061241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:40.063541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:40.172184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1028/2056] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:41:40.185594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:40.187269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:40.324385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488450-d47a-42f6-9061-e71bda732b16 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:40.335391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:40.339384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:40.339946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:40.340604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:40.369557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:40.374860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:40.422066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1029/2057] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:41.210005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:41.211656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:41.227187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2897049-a864-4b4d-8926-1ea2c524b9bc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:41.237089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:41.237089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:41.237089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:41.237089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] PATH_INFO: `/v3/projects/8bcd26ad03744bb8a9af74f0746f2afe` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:41.237415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcd26ad03744bb8a9af74f0746f2afe)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:41.240111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:41.450858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcd26ad03744bb8a9af74f0746f2afe', 'request_id': 'req-50f37f68-dc4c-409f-a907-bc5d6a9d036d'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:41.471775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcd26ad03744bb8a9af74f0746f2afe', 'request_id': 'req-50f37f68-dc4c-409f-a907-bc5d6a9d036d'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:41.481378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcd26ad03744bb8a9af74f0746f2afe', 'request_id': 'req-50f37f68-dc4c-409f-a907-bc5d6a9d036d'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:41.570642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] The token cache is being invalidate because project 8bcd26ad03744bb8a9af74f0746f2afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:41.571221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:41.572053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-50f37f68-dc4c-409f-a907-bc5d6a9d036d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:41.573981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1029/2058] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:41 2022] DELETE /identity/v3/projects/8bcd26ad03744bb8a9af74f0746f2afe => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:41.578250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:41.593450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d2561-f1eb-463f-8960-70127f11a68b service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:41.623395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:41.686019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:41.686836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:41.687217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:41.687623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] PATH_INFO: `/v3/users/abd7ee4defab4ddf94dbb67b4d5540ef` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:41.689941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd7ee4defab4ddf94dbb67b4d5540ef)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:41.693092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:41.942930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd7ee4defab4ddf94dbb67b4d5540ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:42.024116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd7ee4defab4ddf94dbb67b4d5540ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:42.034186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd7ee4defab4ddf94dbb67b4d5540ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:42.035112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd7ee4defab4ddf94dbb67b4d5540ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:42.044856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd7ee4defab4ddf94dbb67b4d5540ef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:42.062093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1030/2059] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:41 2022] DELETE /identity/v3/users/abd7ee4defab4ddf94dbb67b4d5540ef => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:43.426739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90b9e8-0437-42c1-af45-19826e4cded8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:43.427315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90b9e8-0437-42c1-af45-19826e4cded8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:43.427521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90b9e8-0437-42c1-af45-19826e4cded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:43.452103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:43.452103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:43.482216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1f90b9e8-0437-42c1-af45-19826e4cded8 None None] MFA Rules not processed for user `f5ab7ab8489b45c3af75187da20695af`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:43.483496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1f90b9e8-0437-42c1-af45-19826e4cded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:43.594090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b841cf2-6fca-4a0d-8aaf-f0e7c5755a11 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:43.599897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:43.600951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:43.601397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:43.601828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] PATH_INFO: `/v3/projects/3d72cb5ca7aa4296961a140b6bf8fa10` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:43.603239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d72cb5ca7aa4296961a140b6bf8fa10)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:43.605455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:43.631723 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1030/2060] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:43.781692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:43.791943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d72cb5ca7aa4296961a140b6bf8fa10', 'request_id': 'req-e713adcc-4d2f-4656-bcb0-a05c92a501b9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:43.803378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d72cb5ca7aa4296961a140b6bf8fa10', 'request_id': 'req-e713adcc-4d2f-4656-bcb0-a05c92a501b9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:43.809601 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d72cb5ca7aa4296961a140b6bf8fa10', 'request_id': 'req-e713adcc-4d2f-4656-bcb0-a05c92a501b9'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:43.937040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] The token cache is being invalidate because project 3d72cb5ca7aa4296961a140b6bf8fa10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:43.937913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:43.941498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e713adcc-4d2f-4656-bcb0-a05c92a501b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:43.944239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1031/2061] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:43 2022] DELETE /identity/v3/projects/3d72cb5ca7aa4296961a140b6bf8fa10 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:43.949219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:43.949508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:43.949790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.003928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:44.005640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:44.074369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:44.142482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1031/2062] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:44.150315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.153025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.153025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.170747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:44.171983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:44.181599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1032/2063] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:44.185999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.196634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890a418-fbbc-4531-bdd7-8f1874778074 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.202069 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.202690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.202972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.203718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.204157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:41:44.205110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.206665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:44.219477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1032/2064] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:41:44.224026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.234215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c762ae-6c23-4bda-949c-694728eefed3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.244770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.244770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.244770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.244770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.245218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.245218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:44.357547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1033/2065] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:44 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:41:44.362316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.373335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a80c-1c90-4fee-85e0-37b46f757961 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.443373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.444143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.444399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.444679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.445389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.447303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:44.557950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1033/2066] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:44 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:44.561968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.576530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2113c7d-b67c-4516-9fbd-8a2ea5723320 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.582104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.582896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.583319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.583438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.584114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.585733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:44.598570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1034/2067] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:44.602869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.613084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef2e2-93cf-4058-a420-b92aca34df5a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.617839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a82ae-5c14-4559-9298-08f9c03bc374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.618476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a82ae-5c14-4559-9298-08f9c03bc374 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.618755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a82ae-5c14-4559-9298-08f9c03bc374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.619039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a82ae-5c14-4559-9298-08f9c03bc374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.619738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a82ae-5c14-4559-9298-08f9c03bc374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.621372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a82ae-5c14-4559-9298-08f9c03bc374 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:44.633071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1034/2068] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:44.637285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.648589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51b60d-00ce-4ddb-a138-fedd267597e5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.653462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.654219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.654573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.654915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] PATH_INFO: `/v3/projects/8de178f13e934059b2923a28e230294a/users/3d9c85531d0a421b8646835415b8efb6/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.670550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de178f13e934059b2923a28e230294a, user_id=3d9c85531d0a421b8646835415b8efb6, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.673675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:44.778081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1035/2069] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:44 2022] PUT /identity/v3/projects/8de178f13e934059b2923a28e230294a/users/3d9c85531d0a421b8646835415b8efb6/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:44.789794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.790106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.790360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.820488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] MFA Rules not processed for user `3d9c85531d0a421b8646835415b8efb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:44.821892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:44.900814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1035/2070] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:44.905535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:44.983969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6307-c924-4726-a641-d88d208d27f5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:44.990137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:44.990784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:44.991069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:44.992116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:44.992858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:44.995740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.101015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1036/2071] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:44 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:41:45.105106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.116763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda533c6-0a41-428d-84fd-3a8a8325e05a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.138466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:45.189147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.189959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.190245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.190521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.191366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:45.193516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.270881 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1036/2072] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:45 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:45.275710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.292684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a9d0-4dc1-4b69-bb9b-5327ae356deb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.300221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.302503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.302998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.303593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.304629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:45.307967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.340571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1037/2073] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:45.345925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.361450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c02fd-03df-4e83-bda3-8ebb50a6d7a8 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.367865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.368652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.369195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.369552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] PATH_INFO: `/v3/projects/a29cd15518584c38a1a37bf6454f132c/users/dc6c8c2a4bf249b0a38629b64c9e05f1/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.396585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29cd15518584c38a1a37bf6454f132c, user_id=dc6c8c2a4bf249b0a38629b64c9e05f1, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:45.399687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.549795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1037/2074] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:45 2022] PUT /identity/v3/projects/a29cd15518584c38a1a37bf6454f132c/users/dc6c8c2a4bf249b0a38629b64c9e05f1/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:45.550779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.564369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d974f-596f-4e0b-aa12-bb4c71c34e31 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.643423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:45.674121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9c7bb-f8a8-4448-9185-22a40f39e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.674121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9c7bb-f8a8-4448-9185-22a40f39e058 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.674121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9c7bb-f8a8-4448-9185-22a40f39e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.677259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9c7bb-f8a8-4448-9185-22a40f39e058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.678060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9c7bb-f8a8-4448-9185-22a40f39e058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:45.685140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9c7bb-f8a8-4448-9185-22a40f39e058 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.707907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.726621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1038/2075] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:45.747683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475a116-4fa2-4b1b-a3d8-649c3d0a3109 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.749257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.749586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.749924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.752676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2da85-dbb8-4559-9378-049b31179d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.753474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2da85-dbb8-4559-9378-049b31179d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.754150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2da85-dbb8-4559-9378-049b31179d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.754459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2da85-dbb8-4559-9378-049b31179d04 admin admin] PATH_INFO: `/v3/projects/a29cd15518584c38a1a37bf6454f132c/users/dc6c8c2a4bf249b0a38629b64c9e05f1/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.756411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2da85-dbb8-4559-9378-049b31179d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29cd15518584c38a1a37bf6454f132c, user_id=dc6c8c2a4bf249b0a38629b64c9e05f1, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:45.760136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2da85-dbb8-4559-9378-049b31179d04 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.773228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:45.774452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:45.778739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1038/2076] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:45 2022] PUT /identity/v3/projects/a29cd15518584c38a1a37bf6454f132c/users/dc6c8c2a4bf249b0a38629b64c9e05f1/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:45.790036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.790432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.790858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.818390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] MFA Rules not processed for user `dc6c8c2a4bf249b0a38629b64c9e05f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:45.819600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:45.841853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1039/2077] 10.222.0.60 () {58 vars in 967 bytes} [Wed Jul 27 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:45.856606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.862259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:45.900073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1039/2078] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:41:45.912890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:45.914443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:45.932694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac401-9aec-43d8-9e62-2debf52644fd None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.939668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.939668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.939668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.939668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:45.947770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:45.949386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:45.958407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1040/2079] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 08:41:45.988357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b9de1-ee18-4fc4-98bc-05690eeda4e7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:45.992288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749a132-c27d-4002-8c04-22d5bbc4ea76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:45.992959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749a132-c27d-4002-8c04-22d5bbc4ea76 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:45.993245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749a132-c27d-4002-8c04-22d5bbc4ea76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:45.993644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749a132-c27d-4002-8c04-22d5bbc4ea76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:46.004239 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749a132-c27d-4002-8c04-22d5bbc4ea76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:46.005709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749a132-c27d-4002-8c04-22d5bbc4ea76 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:46.015935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1040/2080] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:41:46.294951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:46.305427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5ed9-dbbb-4433-bcf1-f4ed3445b6c3 service swift] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:46.309754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:46.310368 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:46.310647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:46.310984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:46.374157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:46.375646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:46.385861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1041/2081] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:48.102672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebec5ba-36df-4fad-9de5-98aed1f45a91 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:48.103204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebec5ba-36df-4fad-9de5-98aed1f45a91 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:48.103296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebec5ba-36df-4fad-9de5-98aed1f45a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:48.118049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:48.126160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5ebec5ba-36df-4fad-9de5-98aed1f45a91 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:48.127511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5ebec5ba-36df-4fad-9de5-98aed1f45a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:48.136100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1041/2082] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:41:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:48.149631 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:48.161784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0778ca-14a1-4f8b-9c39-4b0a1dcc498b service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:48.167614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f82d2e-51a1-4a25-b31b-6b2e3cc0def3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:48.168322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f82d2e-51a1-4a25-b31b-6b2e3cc0def3 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:48.168604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f82d2e-51a1-4a25-b31b-6b2e3cc0def3 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:48.168911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f82d2e-51a1-4a25-b31b-6b2e3cc0def3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:48.177469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f82d2e-51a1-4a25-b31b-6b2e3cc0def3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:48.179182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f82d2e-51a1-4a25-b31b-6b2e3cc0def3 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:48.182941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:48.189150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1042/2083] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 08:41:49.484081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fab666-bc77-4d17-b813-471524c29aae None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:49.486821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fab666-bc77-4d17-b813-471524c29aae None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:49.488006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fab666-bc77-4d17-b813-471524c29aae None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:49.493377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1042/2084] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:41:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:41:49.503583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:49.503991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:49.504183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:49.540194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] MFA Rules not processed for user `9b2f62b5c7154b66841484f2c1f5cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:49.541848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:49.668272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fab666-bc77-4d17-b813-471524c29aae None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:49.673812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c7fab666-bc77-4d17-b813-471524c29aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:49.713503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1043/2085] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:41:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:41:49.738647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:49.740075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:49.770694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e998-76e9-4cbf-8fef-8603a8c188ee None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:49.787549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:49.788852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:49.789143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:49.789417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:49.805964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:49.812556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:49.825159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1044/2086] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:41:49.858229 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fab666-bc77-4d17-b813-471524c29aae None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:49.864505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:49.865202 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:49.865490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:49.865770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] PATH_INFO: `/v3/users/c485837e09c946f3b391e2bf6ae88322` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:49.867261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c485837e09c946f3b391e2bf6ae88322)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:49.869677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:50.442518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c485837e09c946f3b391e2bf6ae88322'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.443466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c485837e09c946f3b391e2bf6ae88322'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.445048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:50.455940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c485837e09c946f3b391e2bf6ae88322'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.467462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d3d10-7119-42bd-93d4-20ac0f862009 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:50.479841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c485837e09c946f3b391e2bf6ae88322'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.480456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:50.481148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:50.481479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c485837e09c946f3b391e2bf6ae88322'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.481806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:50.482235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] PATH_INFO: `/v3/users/3d9c85531d0a421b8646835415b8efb6` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:50.488282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9c85531d0a421b8646835415b8efb6)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:50.492494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:50.566472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1043/2087] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:49 2022] DELETE /identity/v3/users/c485837e09c946f3b391e2bf6ae88322 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:50.815208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9c85531d0a421b8646835415b8efb6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.911647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9c85531d0a421b8646835415b8efb6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.927630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9c85531d0a421b8646835415b8efb6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.928309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9c85531d0a421b8646835415b8efb6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:50.929068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-15d68021-c0ad-411b-93a4-45298de569f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9c85531d0a421b8646835415b8efb6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:51.005108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:51.005108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:51.008889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1045/2088] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:50 2022] DELETE /identity/v3/users/3d9c85531d0a421b8646835415b8efb6 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:51.035597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.041155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.042174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.101088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:51.102430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:51.174803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:51.183684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a489e-450d-4733-bdf3-9f70551792fa admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:51.191488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:51.192260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.192716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.198626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1046/2089] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:51.210029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:51.210601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] PATH_INFO: `/v3/projects/f040f79e9a3c411696e00ed0c6fd5f93` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.210707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:51.214309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f040f79e9a3c411696e00ed0c6fd5f93)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:51.216612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:51.261251 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:51.357501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47af3e-5ed3-4c1c-a389-48120beef75c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:51.368478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069355e-c768-48d5-bd81-2346bf8aa938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:51.369156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069355e-c768-48d5-bd81-2346bf8aa938 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.372374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069355e-c768-48d5-bd81-2346bf8aa938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.372659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069355e-c768-48d5-bd81-2346bf8aa938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.395214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069355e-c768-48d5-bd81-2346bf8aa938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:51.396607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069355e-c768-48d5-bd81-2346bf8aa938 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:51.415931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f040f79e9a3c411696e00ed0c6fd5f93', 'request_id': 'req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:51.421534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1047/2090] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:41:51.429090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f040f79e9a3c411696e00ed0c6fd5f93', 'request_id': 'req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:51.441502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f040f79e9a3c411696e00ed0c6fd5f93', 'request_id': 'req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:51.554028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] The token cache is being invalidate because project f040f79e9a3c411696e00ed0c6fd5f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:51.554669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:51.555706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4e9c3131-46f3-4495-92f7-be3fc6fd7ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:51.558093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1044/2091] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:50 2022] DELETE /identity/v3/projects/f040f79e9a3c411696e00ed0c6fd5f93 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:51.563184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.565138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.568960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.610072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:51.616213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:51.757759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1048/2092] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:51.766756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.767399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.767559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.825415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:51.827708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:51.858956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1045/2093] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:51.861068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:51.876867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c060166-b2ab-410b-9cff-1aaaaed25ae7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:51.889917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:51.892520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.894237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.895366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.896191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:41:51.897778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:51.900416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:51.955107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1049/2094] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:41:51.959790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:51.973790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892ed1-56c4-40b4-9e2c-daf571be30e6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:51.996194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:51.996889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:51.997167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:51.997482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:51.998160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.000111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.185688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1046/2095] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:51 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:52.190203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:52.216934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506099ba-19b9-4476-b5a3-bc24a030a913 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:52.337478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:52.339218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:52.340304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:52.341061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.341415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.341920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.343684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.346045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.387733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39e1ab-db37-49e5-ac44-0a6cc91ed786 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:52.395246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:52.395912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.396214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.396475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] PATH_INFO: `/v3/projects/8de178f13e934059b2923a28e230294a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.397786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de178f13e934059b2923a28e230294a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.401026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.445824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1050/2096] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:52 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:52.447008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:52.463488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b393e-4bfb-4dc2-9b47-7f05bf218f21 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:52.469835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:52.470768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.471289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.471783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.472701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.475053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.490378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1051/2097] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:52.496941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:52.500656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:52.506980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c27bd-9561-4de8-a988-7ca1b8a7cc18 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:52.512406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:52.513150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.513518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.515783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.517321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.519088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.539653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1052/2098] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:52.540841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:52.567877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f00b-7a76-4762-9c1f-a8b2256eda13 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:52.568327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de178f13e934059b2923a28e230294a', 'request_id': 'req-a65e86b2-3361-4fd5-a58b-7e8821226a73'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:52.578049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de178f13e934059b2923a28e230294a', 'request_id': 'req-a65e86b2-3361-4fd5-a58b-7e8821226a73'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:52.587153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de178f13e934059b2923a28e230294a', 'request_id': 'req-a65e86b2-3361-4fd5-a58b-7e8821226a73'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:52.662114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] The token cache is being invalidate because project 8de178f13e934059b2923a28e230294a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:52.662593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:52.668759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:52.674157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1047/2099] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:52 2022] DELETE /identity/v3/projects/8de178f13e934059b2923a28e230294a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:52.674900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:52.676404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:52.690251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd19b1f-84bd-4824-aa56-43209c781468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:52.690508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd19b1f-84bd-4824-aa56-43209c781468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.690728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd19b1f-84bd-4824-aa56-43209c781468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.690991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd19b1f-84bd-4824-aa56-43209c781468 admin admin] PATH_INFO: `/v3/projects/2ec9dcc5d01c4e3cbbedf319c72d93a7/users/5862fb1cc9b544348139d11009be25ed/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.713633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd19b1f-84bd-4824-aa56-43209c781468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec9dcc5d01c4e3cbbedf319c72d93a7, user_id=5862fb1cc9b544348139d11009be25ed, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.716622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd19b1f-84bd-4824-aa56-43209c781468 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.786063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1053/2100] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:52 2022] PUT /identity/v3/projects/2ec9dcc5d01c4e3cbbedf319c72d93a7/users/5862fb1cc9b544348139d11009be25ed/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:52.792226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e86b2-3361-4fd5-a58b-7e8821226a73 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:52.796335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.796720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.797034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.800866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:52.860109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] MFA Rules not processed for user `5862fb1cc9b544348139d11009be25ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:52.863472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:52.880555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:52.881828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:52.882187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:52.882741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] PATH_INFO: `/v3/users/dc6c8c2a4bf249b0a38629b64c9e05f1` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:52.884286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6c8c2a4bf249b0a38629b64c9e05f1)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:52.886635 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:52.981683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1054/2101] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:52.999040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:53.001785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:53.106254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6c8c2a4bf249b0a38629b64c9e05f1'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:53.120604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6c8c2a4bf249b0a38629b64c9e05f1'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:53.120894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bc2a4-55e9-4ee0-9350-3e44aab090fc None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:53.120894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:53.120894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:53.120894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:53.121425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:53.133390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6c8c2a4bf249b0a38629b64c9e05f1'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:53.155610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6c8c2a4bf249b0a38629b64c9e05f1'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:53.158641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e18a3361-0b37-4c0a-b00b-2b4f84d217ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6c8c2a4bf249b0a38629b64c9e05f1'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:53.181070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:53.181070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:53.190705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1055/2102] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:53.697917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1048/2103] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:41:52 2022] DELETE /identity/v3/users/dc6c8c2a4bf249b0a38629b64c9e05f1 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:54.360072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:54.378564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430946-f9d4-4fba-ac45-2fdf3d23cc40 service glance] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:54.385314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:54.533555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:54.534633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:54.535102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:54.535538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] PATH_INFO: `/v3/projects/a29cd15518584c38a1a37bf6454f132c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:54.538202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29cd15518584c38a1a37bf6454f132c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:54.547287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:54.684067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29cd15518584c38a1a37bf6454f132c', 'request_id': 'req-1ec32176-45fb-45aa-9628-c0912f7cf6e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:54.691366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29cd15518584c38a1a37bf6454f132c', 'request_id': 'req-1ec32176-45fb-45aa-9628-c0912f7cf6e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:54.698736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29cd15518584c38a1a37bf6454f132c', 'request_id': 'req-1ec32176-45fb-45aa-9628-c0912f7cf6e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:54.763706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f303-f59a-43ac-867b-310beb78b366 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:54.764843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f303-f59a-43ac-867b-310beb78b366 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:54.765315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f303-f59a-43ac-867b-310beb78b366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:54.794260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3d97f303-f59a-43ac-867b-310beb78b366 None None] MFA Rules not processed for user `63fa285fd1e14d41977a6cd0ceaabb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:54.794260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3d97f303-f59a-43ac-867b-310beb78b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:54.840411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] The token cache is being invalidate because project a29cd15518584c38a1a37bf6454f132c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:41:54.840934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:54.841644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1ec32176-45fb-45aa-9628-c0912f7cf6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:41:54.843730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1056/2104] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:41:54 2022] DELETE /identity/v3/projects/a29cd15518584c38a1a37bf6454f132c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:54.852137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:54.853354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:54.853745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:54.881456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:54.884021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1049/2105] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:54.902806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:55.012449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1057/2106] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:55.025933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.025933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.025933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.076577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:55.077927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:55.121336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:55.121433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1050/2107] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:55.135093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959460a-3178-401b-84a2-000093d0dc5b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:55.143877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:55.144524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.144882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.145165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.145799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:41:55.146155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:55.147718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:55.175959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1058/2108] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:41:55.180642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:55.192410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d908d3-74a0-44cc-8b3c-76e89860f007 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:55.202643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:55.203290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.203601 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.203962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.205391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:55.213178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:55.385737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1051/2109] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:55 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:55.390197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:55.401332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ebbe-9cfd-478a-bcee-03262be935f9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:55.432931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:55.523604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:55.527240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.528533 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.529006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.531845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:55.534770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:55.687539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1059/2110] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:55 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:55.692680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:55.708904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:55.717031 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17db135-17a4-4da7-94e8-5000213a3706 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:55.732977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:55.733616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.733901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.734176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.734877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:55.736876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:55.758176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1052/2111] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:55.762258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:55.799424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba662a-126a-4440-92b9-609a9c8805a5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:55.808227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcd931-1eed-4923-86ac-1bf451bc2fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:55.810421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcd931-1eed-4923-86ac-1bf451bc2fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.810718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcd931-1eed-4923-86ac-1bf451bc2fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.811812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcd931-1eed-4923-86ac-1bf451bc2fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.813263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcd931-1eed-4923-86ac-1bf451bc2fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:55.815865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcd931-1eed-4923-86ac-1bf451bc2fa0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:55.833904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1060/2112] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:55.835736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:55.848268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3599e-9a20-4b07-99f8-19b3983ce48a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:55.863699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:55.864391 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:55.864676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:55.864988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] PATH_INFO: `/v3/projects/179309bd94454666bcb1b1e8346bb7cf/users/0ebc551423dc4de5b58c97cc4093f59c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:55.887784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179309bd94454666bcb1b1e8346bb7cf, user_id=0ebc551423dc4de5b58c97cc4093f59c, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:55.891147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:56.040515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1053/2113] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:55 2022] PUT /identity/v3/projects/179309bd94454666bcb1b1e8346bb7cf/users/0ebc551423dc4de5b58c97cc4093f59c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:56.050723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:56.051017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:56.051296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:56.151819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] MFA Rules not processed for user `0ebc551423dc4de5b58c97cc4093f59c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:56.151819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:56.285077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1061/2114] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:41:56.298823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:56.420261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85fc3-34e5-44d1-95f8-586f60e8bd14 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:56.426964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:56.427818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:56.432485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:56.432485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:56.432485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:56.432485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:56.583734 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1054/2115] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:41:56 2022] POST /identity/v3/projects => generated 391 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:56.603198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:56.627002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622f49d-a32e-4e46-9456-875dbc767555 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:56.769416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:56.772382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:56.772762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:56.773485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:56.775066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:56.779049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:56.911359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1062/2116] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:41:56 2022] POST /identity/v3/users => generated 302 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:41:56.915075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:56.932214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c149b-74d7-43c9-945c-77d85d861094 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:56.938547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:56.939728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:56.940209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:56.940721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:56.941647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:56.943473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:56.960550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1055/2117] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:56.964814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:56.980199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c345289-e539-43fa-9b8b-f781cb5c0122 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:56.986283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:56.986957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:56.987262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:56.987530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] PATH_INFO: `/v3/projects/15998410413a44f592b6ca92d6a461b2/users/16905f09a3d644ce867c5f59d980e625/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:57.009477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15998410413a44f592b6ca92d6a461b2, user_id=16905f09a3d644ce867c5f59d980e625, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:57.015151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:57.129367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:57.135993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1063/2118] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:56 2022] PUT /identity/v3/projects/15998410413a44f592b6ca92d6a461b2/users/16905f09a3d644ce867c5f59d980e625/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:41:57.140702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:57.162798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b229a-fc74-42ed-b029-d38fc8f39de7 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:57.330457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccabc27-f019-46b8-ae3c-8b2ac22dc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:57.330896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccabc27-f019-46b8-ae3c-8b2ac22dc0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:57.331185 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccabc27-f019-46b8-ae3c-8b2ac22dc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:57.331523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccabc27-f019-46b8-ae3c-8b2ac22dc0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:57.332815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccabc27-f019-46b8-ae3c-8b2ac22dc0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:57.336184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccabc27-f019-46b8-ae3c-8b2ac22dc0a8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:57.361205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:57.363241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1056/2119] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:41:57.374917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcd701-6428-4b9a-a006-fbf76206293d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:57.381046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:57.382139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:57.382139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:57.382358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] PATH_INFO: `/v3/projects/15998410413a44f592b6ca92d6a461b2/users/16905f09a3d644ce867c5f59d980e625/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:57.384703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15998410413a44f592b6ca92d6a461b2, user_id=16905f09a3d644ce867c5f59d980e625, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:57.387177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:57.437293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1064/2120] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:41:57 2022] PUT /identity/v3/projects/15998410413a44f592b6ca92d6a461b2/users/16905f09a3d644ce867c5f59d980e625/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:41:57.437449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:57.437449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:57.437449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:57.534583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] MFA Rules not processed for user `16905f09a3d644ce867c5f59d980e625`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:41:57.539043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:57.616538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:57.703786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1057/2121] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:41:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:41:57.724315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:57.726655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:57.802802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514c9d-dbc0-4137-8d97-69929b041c9b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:57.807491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:57.808456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:57.808968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:57.809462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:57.826253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:57.828216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:57.856108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1065/2122] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:41:57.901045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:41:57.902773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:41:57.926051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f86778-2c12-4146-af7a-f9b0a450fd8b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:41:57.930674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:41:57.931714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:41:57.932201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:41:57.932580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:41:58.058860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:41:58.059662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:41:58.071775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1058/2123] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:41:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:04.076806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:04.078275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:04.231097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00a901-b151-46e1-8d15-9eb83f5d48dc service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:04.240993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:04.241654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:04.241947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:04.242207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] PATH_INFO: `/v3/users/a80cb9c13faf4b79a0861a8b250e0a22` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:04.243452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80cb9c13faf4b79a0861a8b250e0a22)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:04.245527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:04.262190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:04.282488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d989c-2baf-4b40-9165-db005db406ff service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:04.291679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:04.292498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:04.292952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:04.293332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] PATH_INFO: `/v3/users/0ebc551423dc4de5b58c97cc4093f59c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:04.297077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebc551423dc4de5b58c97cc4093f59c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:04.297077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:04.536588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80cb9c13faf4b79a0861a8b250e0a22'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.678915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebc551423dc4de5b58c97cc4093f59c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.679838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebc551423dc4de5b58c97cc4093f59c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.687998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebc551423dc4de5b58c97cc4093f59c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.701156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebc551423dc4de5b58c97cc4093f59c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.701874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8e38b8a-a18f-487d-b0c2-04be53b13b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebc551423dc4de5b58c97cc4093f59c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.717955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80cb9c13faf4b79a0861a8b250e0a22'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.733201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80cb9c13faf4b79a0861a8b250e0a22'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.733983 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80cb9c13faf4b79a0861a8b250e0a22'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.734644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7838a039-2a99-4ed3-bd9f-4875d9115c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80cb9c13faf4b79a0861a8b250e0a22'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:04.754598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1066/2124] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:04 2022] DELETE /identity/v3/users/a80cb9c13faf4b79a0861a8b250e0a22 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:04.758673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:04.758964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:04.759243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:04.776717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:04.781207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:04.783344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:04.836771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1059/2125] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:04 2022] DELETE /identity/v3/users/0ebc551423dc4de5b58c97cc4093f59c => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:42:04.842518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:04.843035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:04.843548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:04.881398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:04.883019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:04.887777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1067/2126] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:04.902595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:04.902595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:04.934975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:04.976269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1060/2127] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:04.986817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:04.988701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:05.028429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94492a-6bae-48c9-b978-e98b5001d54e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:05.081443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a3de0-c127-43c4-8d20-3027f34ed3ab None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:05.085842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:05.087599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:05.087987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:05.088544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:05.119433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:05.124362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:05.161622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1061/2128] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:42:05.169029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:05.169536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:05.169536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:05.172845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:05.191736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:05.193242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:05.218062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1068/2129] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:05.923511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:05.927430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:05.929294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:05.930248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:05.945898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f8921-c4fc-4268-a376-330ebff00b71 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:05.947268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b874-5572-4f60-a0c9-c8503ce5815a service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:05.952266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:05.952977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:05.953321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:05.953579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] PATH_INFO: `/v3/projects/179309bd94454666bcb1b1e8346bb7cf` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:05.955768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:05.955933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179309bd94454666bcb1b1e8346bb7cf)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:05.956423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:05.956714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:05.962124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] PATH_INFO: `/v3/projects/27ed9bc12bac44de88c5163af8a1c36c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:05.962124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ed9bc12bac44de88c5163af8a1c36c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:05.962322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:05.962415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:06.106829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179309bd94454666bcb1b1e8346bb7cf', 'request_id': 'req-17fe1767-ecc9-4876-845c-b2b99bbbeb19'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.114878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179309bd94454666bcb1b1e8346bb7cf', 'request_id': 'req-17fe1767-ecc9-4876-845c-b2b99bbbeb19'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.120329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:06.121181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179309bd94454666bcb1b1e8346bb7cf', 'request_id': 'req-17fe1767-ecc9-4876-845c-b2b99bbbeb19'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.128605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ed9bc12bac44de88c5163af8a1c36c', 'request_id': 'req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.134875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ed9bc12bac44de88c5163af8a1c36c', 'request_id': 'req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.140423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ed9bc12bac44de88c5163af8a1c36c', 'request_id': 'req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.212443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] The token cache is being invalidate because project 179309bd94454666bcb1b1e8346bb7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:06.212992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.213317 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.214852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1069/2130] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:05 2022] DELETE /identity/v3/projects/179309bd94454666bcb1b1e8346bb7cf => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:42:06.218745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:06.220133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:06.285782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1767-ecc9-4876-845c-b2b99bbbeb19 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:06.291546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] The token cache is being invalidate because project 27ed9bc12bac44de88c5163af8a1c36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:06.291844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.292474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.294207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1062/2131] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:05 2022] DELETE /identity/v3/projects/27ed9bc12bac44de88c5163af8a1c36c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:06.355783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:06.356452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:06.356752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:06.357155 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] PATH_INFO: `/v3/users/16905f09a3d644ce867c5f59d980e625` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:06.362061 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16905f09a3d644ce867c5f59d980e625)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:06.364558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:06.559902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16905f09a3d644ce867c5f59d980e625'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.634965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16905f09a3d644ce867c5f59d980e625'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.643427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16905f09a3d644ce867c5f59d980e625'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.644263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16905f09a3d644ce867c5f59d980e625'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.644968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ead896b8-ede0-4ee5-9fe3-3febf93b18a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16905f09a3d644ce867c5f59d980e625'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:06.666725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1070/2132] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:06 2022] DELETE /identity/v3/users/16905f09a3d644ce867c5f59d980e625 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:42:07.154383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:07.157722 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:07.174972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fc8f-d3cb-4d51-8cd1-5d04cbdfa10a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:07.238589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:07.239347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.239636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.239918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] PATH_INFO: `/v3/projects/15998410413a44f592b6ca92d6a461b2` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.241144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15998410413a44f592b6ca92d6a461b2)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:07.243063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:07.245720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:07.351530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15998410413a44f592b6ca92d6a461b2', 'request_id': 'req-daabbc5f-3952-4bad-8380-8680283c55b7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:07.357687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15998410413a44f592b6ca92d6a461b2', 'request_id': 'req-daabbc5f-3952-4bad-8380-8680283c55b7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:07.363761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15998410413a44f592b6ca92d6a461b2', 'request_id': 'req-daabbc5f-3952-4bad-8380-8680283c55b7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:07.461983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] The token cache is being invalidate because project 15998410413a44f592b6ca92d6a461b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:07.462309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:07.462938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-daabbc5f-3952-4bad-8380-8680283c55b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:07.464472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1063/2133] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:07 2022] DELETE /identity/v3/projects/15998410413a44f592b6ca92d6a461b2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:42:07.469413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.470664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.470914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.492470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:07.493737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:07.504849 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:07.560256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1071/2134] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:07.568400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.568718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.569026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.589087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:07.590299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:07.599050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1064/2135] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:07.603574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:07.614749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b060d-18a2-49d9-9f63-79015ee40385 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:07.619715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:07.620336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.623333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.623333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.623333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:42:07.623333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:07.623932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:07.636001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1072/2136] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:42:07.640833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:07.651837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6e830-e8bf-4c0d-83a6-80827d35f748 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:07.656901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:07.657690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.658107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.658468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.659215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:07.661752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:07.754830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1065/2137] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:07 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:07.756226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:07.767226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d79f86-92a7-4a1d-a6d6-13381a2cff52 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:07.823347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:07.823976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.824258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.824529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.825229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:07.827141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:07.949717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1073/2138] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:07 2022] POST /identity/v3/users => generated 305 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:07.953701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:07.964618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677ea6-ccf0-431f-8a47-eac7a320a7c4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:07.969339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:07.969966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:07.970217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:07.970488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:07.971255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:07.972845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:07.983520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1066/2139] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:07.987660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:07.997589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e1f1c-1de6-4bf5-a921-ef0415ea07e3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.003095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b09025-2730-46f2-86d7-132db940738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.003705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09025-2730-46f2-86d7-132db940738b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.003992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09025-2730-46f2-86d7-132db940738b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.004270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09025-2730-46f2-86d7-132db940738b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.005023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b09025-2730-46f2-86d7-132db940738b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.006620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b09025-2730-46f2-86d7-132db940738b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.017884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1074/2140] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:08.022138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.032401 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756292-33f4-49c4-bbc1-e22806e48071 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.037161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.037863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.038145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.038423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] PATH_INFO: `/v3/projects/85a7034a11eb4663aed4f350b3d0ed2f/users/7fe6bbf2e1bc4af68cf08fa9c4e006a5/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.054850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a7034a11eb4663aed4f350b3d0ed2f, user_id=7fe6bbf2e1bc4af68cf08fa9c4e006a5, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.057597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.160884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1067/2141] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:08 2022] PUT /identity/v3/projects/85a7034a11eb4663aed4f350b3d0ed2f/users/7fe6bbf2e1bc4af68cf08fa9c4e006a5/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:08.172418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.173231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.173534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.201733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] MFA Rules not processed for user `7fe6bbf2e1bc4af68cf08fa9c4e006a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:08.202930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:08.266411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1075/2142] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:08.271089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.330440 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592783a-0c96-4832-a18a-df47ecdef2e4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.335049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.335650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.335928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.336201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.336891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.338765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.426361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1068/2143] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:08 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:08.430393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.441716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93e0e-da00-437f-89cf-7f3f023ff6b6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.449856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:08.499797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.500575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.501031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.501420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.502117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.504096 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.583616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1076/2144] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:08 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:08.587716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.598462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76c3f1-f8b5-4a1d-9908-6ab5ca902755 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.603324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.605413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.605413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.605413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.605413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.606778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.618123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1069/2145] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:42:08.622517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.632757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786e75-c52f-4e2a-acd2-3006465639c7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.637436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.638093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.638379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.638659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] PATH_INFO: `/v3/projects/99925b04bb5243fc868561f2be313684/users/3646fb2c837f4ab58a26635e22345d14/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.653256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99925b04bb5243fc868561f2be313684, user_id=3646fb2c837f4ab58a26635e22345d14, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.656076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.801403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1077/2146] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:08 2022] PUT /identity/v3/projects/99925b04bb5243fc868561f2be313684/users/3646fb2c837f4ab58a26635e22345d14/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:08.813269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.819276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:08.824400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dbe96-bcf7-433f-80fc-023d464080da admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.882173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b87bc-b6f3-4ba2-be2f-3a2ae87b4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.882801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b87bc-b6f3-4ba2-be2f-3a2ae87b4239 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.883089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b87bc-b6f3-4ba2-be2f-3a2ae87b4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.883370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b87bc-b6f3-4ba2-be2f-3a2ae87b4239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.884070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b87bc-b6f3-4ba2-be2f-3a2ae87b4239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.885756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b87bc-b6f3-4ba2-be2f-3a2ae87b4239 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.896457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1070/2147] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:08.900634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:08.911560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4872eb-2171-46f5-a824-aafad0a762a7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:08.916374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:08.917083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.917367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.917638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] PATH_INFO: `/v3/projects/99925b04bb5243fc868561f2be313684/users/3646fb2c837f4ab58a26635e22345d14/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.919713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99925b04bb5243fc868561f2be313684, user_id=3646fb2c837f4ab58a26635e22345d14, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:08.922606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:08.933325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1078/2148] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:08 2022] PUT /identity/v3/projects/99925b04bb5243fc868561f2be313684/users/3646fb2c837f4ab58a26635e22345d14/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:08.943824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:08.944113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:08.944389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:08.972378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] MFA Rules not processed for user `3646fb2c837f4ab58a26635e22345d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:08.973597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:09.042540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1071/2149] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:09.054099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:09.055801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:09.116103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfef4c-8b2a-4b3c-abda-008ca7c05c00 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:09.120196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c1d2-ea00-481f-8a3a-001396498085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:09.120858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c1d2-ea00-481f-8a3a-001396498085 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:09.121140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c1d2-ea00-481f-8a3a-001396498085 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:09.121415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c1d2-ea00-481f-8a3a-001396498085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:09.131249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c1d2-ea00-481f-8a3a-001396498085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:09.132691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c1d2-ea00-481f-8a3a-001396498085 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:09.142330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1079/2150] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:09.525322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:09.526785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:09.539777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d48d-31b6-40d9-bc1a-6edbf5209c6f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:09.543739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc22e1-626c-4693-9c10-09eb5b23f97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:09.544309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc22e1-626c-4693-9c10-09eb5b23f97f service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:09.544613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc22e1-626c-4693-9c10-09eb5b23f97f service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:09.544910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc22e1-626c-4693-9c10-09eb5b23f97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:09.606175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc22e1-626c-4693-9c10-09eb5b23f97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:09.607626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc22e1-626c-4693-9c10-09eb5b23f97f service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:09.617529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1072/2151] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:12.077952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318797c-e618-4183-bd60-f1d0d3eda0e5 None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.078447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318797c-e618-4183-bd60-f1d0d3eda0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.078595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318797c-e618-4183-bd60-f1d0d3eda0e5 None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.080001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1080/2152] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:42:12.086289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea30bd-57e5-4083-8612-ddaadb1088c5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.086769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea30bd-57e5-4083-8612-ddaadb1088c5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.086864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea30bd-57e5-4083-8612-ddaadb1088c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.107573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e6ea30bd-57e5-4083-8612-ddaadb1088c5 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:12.108802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e6ea30bd-57e5-4083-8612-ddaadb1088c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:12.128349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:12.180899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1073/2153] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:42:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:12.194927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318797c-e618-4183-bd60-f1d0d3eda0e5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:12.194927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0318797c-e618-4183-bd60-f1d0d3eda0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:12.253243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318797c-e618-4183-bd60-f1d0d3eda0e5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:12.256818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec3b1-52bb-432f-bf57-4ef7865f80f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:12.257434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec3b1-52bb-432f-bf57-4ef7865f80f8 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.257714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec3b1-52bb-432f-bf57-4ef7865f80f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.258093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec3b1-52bb-432f-bf57-4ef7865f80f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.268779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec3b1-52bb-432f-bf57-4ef7865f80f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:12.270239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec3b1-52bb-432f-bf57-4ef7865f80f8 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:12.282575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1081/2154] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:12.506876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb90bf9-2b43-410d-b121-b7beaabaac16 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.507166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb90bf9-2b43-410d-b121-b7beaabaac16 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.507451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb90bf9-2b43-410d-b121-b7beaabaac16 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.508910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1074/2155] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:42:12.514019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b204237-ad0e-47a2-bb36-ca82a4eae0c2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.514307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b204237-ad0e-47a2-bb36-ca82a4eae0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.514584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b204237-ad0e-47a2-bb36-ca82a4eae0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.536092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6b204237-ad0e-47a2-bb36-ca82a4eae0c2 None None] MFA Rules not processed for user `aefebccee9e74e91a48485fa6f074698`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:12.537481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6b204237-ad0e-47a2-bb36-ca82a4eae0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:12.541860 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:12.589264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1082/2156] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:42:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:12.602129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb90bf9-2b43-410d-b121-b7beaabaac16 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:12.603852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9bb90bf9-2b43-410d-b121-b7beaabaac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:12.617552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb90bf9-2b43-410d-b121-b7beaabaac16 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:12.621224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f811f7-c817-450e-b280-52a7f51d7729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:12.621838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f811f7-c817-450e-b280-52a7f51d7729 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.622122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f811f7-c817-450e-b280-52a7f51d7729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.622400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f811f7-c817-450e-b280-52a7f51d7729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.630039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f811f7-c817-450e-b280-52a7f51d7729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:12.631463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f811f7-c817-450e-b280-52a7f51d7729 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:12.639319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1075/2157] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:12.757077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729628-2f2c-4532-9710-451ba8f50c8e None None] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.757363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729628-2f2c-4532-9710-451ba8f50c8e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.757634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729628-2f2c-4532-9710-451ba8f50c8e None None] PATH_INFO: `/` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.758981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1083/2158] 10.222.0.60 () {54 vars in 921 bytes} [Wed Jul 27 08:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:42:12.763820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.764108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.764382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.785054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] MFA Rules not processed for user `bb119ceb349f429aacde98d2940dde47`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:12.786271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:12.798074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1076/2159] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Jul 27 08:42:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:12.806770 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729628-2f2c-4532-9710-451ba8f50c8e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:12.808488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-86729628-2f2c-4532-9710-451ba8f50c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:12.821780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729628-2f2c-4532-9710-451ba8f50c8e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:12.825301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db99d-6423-4bf5-b595-f483ada01e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:12.825905 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db99d-6423-4bf5-b595-f483ada01e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:12.826185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db99d-6423-4bf5-b595-f483ada01e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:12.826456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db99d-6423-4bf5-b595-f483ada01e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:12.837244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2db99d-6423-4bf5-b595-f483ada01e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:12.838663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2db99d-6423-4bf5-b595-f483ada01e7f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:12.850206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1084/2160] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:16.669236 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:16.741270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b30b7-2084-4a5b-a792-cef59cfe4d03 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:16.746844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:16.747860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:16.748225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:16.748577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] PATH_INFO: `/v3/users/7fe6bbf2e1bc4af68cf08fa9c4e006a5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:16.749963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe6bbf2e1bc4af68cf08fa9c4e006a5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:16.752047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:16.976220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe6bbf2e1bc4af68cf08fa9c4e006a5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:16.977265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe6bbf2e1bc4af68cf08fa9c4e006a5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:16.991867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe6bbf2e1bc4af68cf08fa9c4e006a5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:17.022708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe6bbf2e1bc4af68cf08fa9c4e006a5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:17.023451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-da94b0a0-9f6a-4500-adb2-3e8e7246672c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe6bbf2e1bc4af68cf08fa9c4e006a5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:17.114696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1077/2161] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:16 2022] DELETE /identity/v3/users/7fe6bbf2e1bc4af68cf08fa9c4e006a5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:17.126108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:17.126575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:17.126667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:17.147453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:17.148653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:17.249746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:17.250042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:17.250313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:17.252647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1085/2162] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:17.269239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:17.271782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:17.281501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:17.282120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:17.291696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:17.357576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f238b4-94b6-45fc-a641-1673107b0b21 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:17.364179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:17.364842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:17.365124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:17.365400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:17.380335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:17.394235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:17.395067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1078/2163] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:42:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:17.407666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:17.410248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:17.418603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1086/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:17.494675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71fb1f-42c1-4d14-b74b-14adc8373b36 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:17.501219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:17.501873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:17.502153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:17.505627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:17.513940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:17.515553 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:17.545594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1079/2165] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:42:17.913058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:17.914726 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:17.938070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc55216-9c8a-4552-9739-f1b488542908 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:17.945396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:17.946463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:17.946798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:17.947199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] PATH_INFO: `/v3/projects/85a7034a11eb4663aed4f350b3d0ed2f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:17.949181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a7034a11eb4663aed4f350b3d0ed2f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:17.962356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:18.136789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a7034a11eb4663aed4f350b3d0ed2f', 'request_id': 'req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.138081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:18.145694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a7034a11eb4663aed4f350b3d0ed2f', 'request_id': 'req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.167977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a7034a11eb4663aed4f350b3d0ed2f', 'request_id': 'req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.254354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] The token cache is being invalidate because project 85a7034a11eb4663aed4f350b3d0ed2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:18.254909 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.255602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.257489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1087/2166] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:17 2022] DELETE /identity/v3/projects/85a7034a11eb4663aed4f350b3d0ed2f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:18.261746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:18.273653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b607-ea71-47cf-95f9-626621f391e4 service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:18.361310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:18.362062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:18.362487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:18.362947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] PATH_INFO: `/v3/users/3646fb2c837f4ab58a26635e22345d14` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:18.366172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3646fb2c837f4ab58a26635e22345d14)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:18.368697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:18.600423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3646fb2c837f4ab58a26635e22345d14'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.601413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3646fb2c837f4ab58a26635e22345d14'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.603785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:18.609084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3646fb2c837f4ab58a26635e22345d14'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.623496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3646fb2c837f4ab58a26635e22345d14'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.624497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f734ed5-6523-4540-9f6d-afaff3a3a95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3646fb2c837f4ab58a26635e22345d14'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:18.749166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1080/2167] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:18 2022] DELETE /identity/v3/users/3646fb2c837f4ab58a26635e22345d14 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:19.180855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:19.181494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:19.204651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa04871-7586-4d33-b0a1-c0cdd8bb90bb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:19.277490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:19.278183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:19.278469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:19.278976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] PATH_INFO: `/v3/projects/99925b04bb5243fc868561f2be313684` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:19.280205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99925b04bb5243fc868561f2be313684)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:19.282291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:19.400119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99925b04bb5243fc868561f2be313684', 'request_id': 'req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:19.408573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99925b04bb5243fc868561f2be313684', 'request_id': 'req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:19.415265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99925b04bb5243fc868561f2be313684', 'request_id': 'req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:19.479668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] The token cache is being invalidate because project 99925b04bb5243fc868561f2be313684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:19.479974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:19.480601 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d2dd4b8-cd59-4db9-b92a-aa099a1f4566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:19.482202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1088/2168] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:19 2022] DELETE /identity/v3/projects/99925b04bb5243fc868561f2be313684 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:19.487374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:19.487902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:19.488044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:19.512300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:19.516589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:19.578648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1081/2169] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:19.588129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:19.588422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:19.588705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:19.609717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:19.611003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:19.619589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1089/2170] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:19.623690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:19.633957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a5546-6d28-4226-a2d2-8189d526c29f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:19.639042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:19.639678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:19.639973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:19.640303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:19.641017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:42:19.641333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:19.642949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:19.657228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1082/2171] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:42:19.660955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:19.670844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47160a-4457-4c5d-9ea2-2d18c0aafe16 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:19.676700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:19.677362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:19.677645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:19.677922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:19.678596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:19.680668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:19.777080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1090/2172] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:19 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:42:19.778328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:19.790266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b58669-3358-4361-b0d0-fd5e0b339eaa admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:19.854702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:19.855332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:19.855615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:19.855890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:19.856572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:19.858522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:20.146323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1083/2173] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:19 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:42:20.149252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:20.161299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a83ff-7ef6-4137-b277-72da3e21a765 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:20.166694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:20.167547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:20.168118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:20.168391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:20.169173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:20.170824 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:20.186483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1091/2174] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:20.187700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:20.198180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb354b-7df7-4ffa-abad-8c6cc23232b2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:20.205300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee8c7-8b59-410a-af6c-db2e26c13a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:20.211878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee8c7-8b59-410a-af6c-db2e26c13a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:20.211878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee8c7-8b59-410a-af6c-db2e26c13a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:20.211878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee8c7-8b59-410a-af6c-db2e26c13a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:20.211878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee8c7-8b59-410a-af6c-db2e26c13a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:20.211878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ee8c7-8b59-410a-af6c-db2e26c13a0c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:20.220808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1084/2175] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:20.226266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:20.237207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86680e86-660a-463e-99b3-40e8d45523fe admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:20.247323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:20.248306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:20.248597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:20.248903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] PATH_INFO: `/v3/projects/b2eab502f97f4c0c8e3dc3b7d355df83/users/728cdb2919b54063a49403d879c92713/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:20.268856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2eab502f97f4c0c8e3dc3b7d355df83, user_id=728cdb2919b54063a49403d879c92713, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:20.284113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:20.402249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:20.408127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1092/2176] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:20 2022] PUT /identity/v3/projects/b2eab502f97f4c0c8e3dc3b7d355df83/users/728cdb2919b54063a49403d879c92713/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:20.419471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:20.419762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:20.419863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:20.451637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] MFA Rules not processed for user `728cdb2919b54063a49403d879c92713`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:20.453086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:20.479387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:20.549831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1085/2177] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:20.551630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:20.669722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1b4a1-6799-4ede-91ba-f23da86e58cf admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:20.675396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:20.676397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:20.676842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:20.677221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:20.677913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:20.679954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:20.858343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1093/2178] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:20 2022] POST /identity/v3/projects => generated 379 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:20.859866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:20.871356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797da1d-3e43-4114-92f7-8f1eebc7356e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:20.936633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:20.937213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:20.937495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:20.937768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:20.938436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:20.940373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.021768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1086/2179] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:20 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:21.025399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.038884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df4ae-6cde-463c-8e38-3432df2bdcc0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.053692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.054628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.055013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.055503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.056450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.058328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.072622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1094/2180] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:42:21.076094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.087596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf498-1e19-4051-90ba-3063fd446a13 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.092484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b40a3-2fed-4fe2-a87c-2ccab128c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.093186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b40a3-2fed-4fe2-a87c-2ccab128c66d admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.093474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b40a3-2fed-4fe2-a87c-2ccab128c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.093755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b40a3-2fed-4fe2-a87c-2ccab128c66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.094499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b40a3-2fed-4fe2-a87c-2ccab128c66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.096108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b40a3-2fed-4fe2-a87c-2ccab128c66d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.107415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1087/2181] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:21.111791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.123963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befcf44-791a-453e-8dc1-e1de80e2257e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.129663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.130595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.130884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.131161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] PATH_INFO: `/v3/projects/7905293f7c7847ca89712cec0975c84d/users/9b824d890fb742a0b9a6eaf5876929a1/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.150926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7905293f7c7847ca89712cec0975c84d, user_id=9b824d890fb742a0b9a6eaf5876929a1, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.153755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.220963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1095/2182] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:21 2022] PUT /identity/v3/projects/7905293f7c7847ca89712cec0975c84d/users/9b824d890fb742a0b9a6eaf5876929a1/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:21.233141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.233531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.234128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.272275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] MFA Rules not processed for user `9b824d890fb742a0b9a6eaf5876929a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:21.272275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:21.365821 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1088/2183] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:21.370385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.436090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bf37-fc23-45ae-82fb-2c5bd39e4fd0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.440890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.442372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.442676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.442953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.443690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.445586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.529441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1096/2184] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:21 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:21.530604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.542224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0b0df-f20b-4b5c-867c-7ac0ee6f3f23 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.577451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:21.612015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.612649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.612966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.613899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.614637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.616564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.724137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1089/2185] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:21 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:21.728328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.743162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530af693-dad3-4d81-9877-ce89ed96a973 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.748987 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.753959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.753959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.753959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.753959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.753959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.792397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1097/2186] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:21.793643 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.808469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd445-5447-4c6b-9c0d-c9c10664dba0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.820720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:21.821467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:21.821747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:21.822082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] PATH_INFO: `/v3/projects/d80d03777af040999290ca6f7a950da1/users/9748d54e24d24b40a1ace83e97d13fb2/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:21.854420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80d03777af040999290ca6f7a950da1, user_id=9748d54e24d24b40a1ace83e97d13fb2, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:21.858167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:21.937213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1090/2187] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:21 2022] PUT /identity/v3/projects/d80d03777af040999290ca6f7a950da1/users/9748d54e24d24b40a1ace83e97d13fb2/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:21.941375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:21.952470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a9de-8f02-41f9-9a7f-1b53a1f58092 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:21.975356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:22.014903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17060-8c4d-41eb-9b4d-8b2a20eb5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:22.015521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17060-8c4d-41eb-9b4d-8b2a20eb5073 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.015840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17060-8c4d-41eb-9b4d-8b2a20eb5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.016207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17060-8c4d-41eb-9b4d-8b2a20eb5073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.016921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df17060-8c4d-41eb-9b4d-8b2a20eb5073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:22.021777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df17060-8c4d-41eb-9b4d-8b2a20eb5073 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:22.033622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1098/2188] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:22.038426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:22.050113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaff9d-8730-4d66-bf34-146675c77727 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:22.056244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:22.057158 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.057538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.057902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] PATH_INFO: `/v3/projects/d80d03777af040999290ca6f7a950da1/users/9748d54e24d24b40a1ace83e97d13fb2/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.060157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80d03777af040999290ca6f7a950da1, user_id=9748d54e24d24b40a1ace83e97d13fb2, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:22.063120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:22.074691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1091/2189] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:22 2022] PUT /identity/v3/projects/d80d03777af040999290ca6f7a950da1/users/9748d54e24d24b40a1ace83e97d13fb2/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:22.147204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.147491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.147803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.177026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] MFA Rules not processed for user `9748d54e24d24b40a1ace83e97d13fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:22.178247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:22.256528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1099/2190] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:22.268061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:22.270550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:22.321773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:22.326193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:22.340347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155eb96-09d2-461e-b4bd-235d7d918229 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:22.344419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:22.345152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.345506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.345790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.356625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:22.358134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:22.369076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1092/2191] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:22.418292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fdd3-b881-4164-ae8d-a17894a7cde6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:22.423215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:22.423917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.424211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.424486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] PATH_INFO: `/v3/users/5862fb1cc9b544348139d11009be25ed` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.425970 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5862fb1cc9b544348139d11009be25ed)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:22.428053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:22.522150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:22.523869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:22.538014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6288c6b-a5b1-4113-8211-09ebffc35be1 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:22.545423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3e909-18b4-4451-93db-a321d8a8046f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:22.546121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3e909-18b4-4451-93db-a321d8a8046f service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.546420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3e909-18b4-4451-93db-a321d8a8046f service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.546774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3e909-18b4-4451-93db-a321d8a8046f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.607813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:22.610468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5862fb1cc9b544348139d11009be25ed'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:22.624653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3e909-18b4-4451-93db-a321d8a8046f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:22.626161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3e909-18b4-4451-93db-a321d8a8046f service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:22.637049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1093/2192] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:42:22.698516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5862fb1cc9b544348139d11009be25ed'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:22.707938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5862fb1cc9b544348139d11009be25ed'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:22.708768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5862fb1cc9b544348139d11009be25ed'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:22.709693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5862fb1cc9b544348139d11009be25ed'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:22.729933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1100/2193] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:22 2022] DELETE /identity/v3/users/5862fb1cc9b544348139d11009be25ed => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:22.734633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.734929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.735211 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:22.757876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:22.759109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:22.787579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:22.845780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1094/2194] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:22.855569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:22.859761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:22.986021 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1d3e3-fd19-42e5-a38a-7bdc0b382f64 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:22.991627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb230be-beae-4183-8fd8-2a26160a2c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:22.993247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb230be-beae-4183-8fd8-2a26160a2c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:22.993609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb230be-beae-4183-8fd8-2a26160a2c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:22.993954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb230be-beae-4183-8fd8-2a26160a2c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:23.007747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb230be-beae-4183-8fd8-2a26160a2c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:23.009441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb230be-beae-4183-8fd8-2a26160a2c7a service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:23.027962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1101/2195] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:24.672082 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:24.674377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:24.689341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a5d1-becc-4b11-900b-a5bf93a6908e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:24.715378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:24.716087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:24.716486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:24.716688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] PATH_INFO: `/v3/projects/2ec9dcc5d01c4e3cbbedf319c72d93a7` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:24.718479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec9dcc5d01c4e3cbbedf319c72d93a7)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:24.720927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:24.892915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec9dcc5d01c4e3cbbedf319c72d93a7', 'request_id': 'req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:24.899486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec9dcc5d01c4e3cbbedf319c72d93a7', 'request_id': 'req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:24.909342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec9dcc5d01c4e3cbbedf319c72d93a7', 'request_id': 'req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:24.973361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] The token cache is being invalidate because project 2ec9dcc5d01c4e3cbbedf319c72d93a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:24.973657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:24.974303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-fcbef9bd-d7df-4cf7-972c-8a9c1770d8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:24.976110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1095/2196] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:24 2022] DELETE /identity/v3/projects/2ec9dcc5d01c4e3cbbedf319c72d93a7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:24.981228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:24.982112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:24.982434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.012762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:25.014029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:25.092224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1102/2197] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:25.101064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.101491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.101897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.123190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:25.124373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:25.133606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1096/2198] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:25.138296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.149275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c00fa4-e889-4e43-9203-a6a1e2c67c8c None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.161722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.162455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.162805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.163175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.164056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:42:25.164423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:25.166408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:25.183785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1103/2199] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:42:25.184981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.195579 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bd99b-0340-40c5-a70a-10b658aa2c67 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.200973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.201692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.202067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.202540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.203241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:25.205266 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:25.317606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1097/2200] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:25 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:25.322868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.333014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95431a-eac5-4fb2-8bd6-aa1e4cb755c3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.402553 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:25.417002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.417973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.418260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.418537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.419211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:25.421233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:25.523927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1104/2201] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:25 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:42:25.528150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.541181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216919b-bc0e-42c3-81a7-6a56670146b5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.556197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.557073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.557609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.558037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.558948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:25.560902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:25.574353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1098/2202] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:25.578505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.590475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936b4d-f600-47d0-90c1-1bcbaed4d8a5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.600311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088425-48e5-43b7-8233-e9c7877ff2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.611310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088425-48e5-43b7-8233-e9c7877ff2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.611310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088425-48e5-43b7-8233-e9c7877ff2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.611310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088425-48e5-43b7-8233-e9c7877ff2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.611310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a088425-48e5-43b7-8233-e9c7877ff2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:25.611310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a088425-48e5-43b7-8233-e9c7877ff2ad admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:25.622534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1105/2203] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:25.627088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.640551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be448c5e-2cda-4669-98cf-25bdbcd25310 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.646197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.646885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.647171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.647474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] PATH_INFO: `/v3/projects/51a4f53f53764e0a9fe9a54b562462b5/users/9c43a138fd9b438d9719f8fd9fe80467/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.667768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a4f53f53764e0a9fe9a54b562462b5, user_id=9c43a138fd9b438d9719f8fd9fe80467, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:25.671473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:25.745705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1099/2204] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:25 2022] PUT /identity/v3/projects/51a4f53f53764e0a9fe9a54b562462b5/users/9c43a138fd9b438d9719f8fd9fe80467/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:25.757812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.758094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.758366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.789395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] MFA Rules not processed for user `9c43a138fd9b438d9719f8fd9fe80467`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:25.791580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:25.871413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1106/2205] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:25.888454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:25.890425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:25.959402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:25.981104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7767-3be1-45bc-b1c9-e5e05d7239e1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:25.988936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a5d1-1581-46e1-aafe-6426ef2421c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:25.989591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a5d1-1581-46e1-aafe-6426ef2421c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:25.989883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a5d1-1581-46e1-aafe-6426ef2421c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:25.990162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a5d1-1581-46e1-aafe-6426ef2421c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:25.999863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162a5d1-1581-46e1-aafe-6426ef2421c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:26.001358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162a5d1-1581-46e1-aafe-6426ef2421c8 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:26.015107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1100/2206] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:28.025925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:28.027391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:28.095327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed0447-f176-4c47-858f-9e37aa90240f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:28.100861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:28.101522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:28.101800 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:28.102068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] PATH_INFO: `/v3/users/728cdb2919b54063a49403d879c92713` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:28.103207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728cdb2919b54063a49403d879c92713)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:28.105159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:28.311255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728cdb2919b54063a49403d879c92713'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:28.389603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728cdb2919b54063a49403d879c92713'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:28.397456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728cdb2919b54063a49403d879c92713'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:28.398089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728cdb2919b54063a49403d879c92713'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:28.398763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728cdb2919b54063a49403d879c92713'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:28.400034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:28.417967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1107/2207] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:28 2022] DELETE /identity/v3/users/728cdb2919b54063a49403d879c92713 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:28.422730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:28.423230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:28.423354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:28.443294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:28.444519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:28.505634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1101/2208] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:28.517855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:28.517855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:28.576266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a481-6919-4b4d-9a34-cc87e9df0256 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:28.579961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:28.580565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:28.580881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:28.581159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:28.590928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:28.592408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:28.602127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1108/2209] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:28.996623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:28.998134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:29.021256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2693a9-a734-4bd7-9b9a-7583f18e97a8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:29.027189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:29.028720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:29.029103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:29.029477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] PATH_INFO: `/v3/projects/b2eab502f97f4c0c8e3dc3b7d355df83` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:29.030769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2eab502f97f4c0c8e3dc3b7d355df83)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:29.032834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:29.137529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2eab502f97f4c0c8e3dc3b7d355df83', 'request_id': 'req-731fc4ae-a72d-47a5-a5cd-155a85b299a3'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.143727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2eab502f97f4c0c8e3dc3b7d355df83', 'request_id': 'req-731fc4ae-a72d-47a5-a5cd-155a85b299a3'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.150976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2eab502f97f4c0c8e3dc3b7d355df83', 'request_id': 'req-731fc4ae-a72d-47a5-a5cd-155a85b299a3'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.223770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] The token cache is being invalidate because project b2eab502f97f4c0c8e3dc3b7d355df83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:29.224077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.225035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.226716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1102/2210] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:28 2022] DELETE /identity/v3/projects/b2eab502f97f4c0c8e3dc3b7d355df83 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:29.230549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:29.242051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323dbf4-3bd1-4278-9f5a-8dbd3045f94e service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:29.304421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:29.305489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:29.306867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:29.306867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] PATH_INFO: `/v3/users/9b824d890fb742a0b9a6eaf5876929a1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:29.307537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b824d890fb742a0b9a6eaf5876929a1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:29.309513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:29.515763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b824d890fb742a0b9a6eaf5876929a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.589877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b824d890fb742a0b9a6eaf5876929a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.597791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b824d890fb742a0b9a6eaf5876929a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.598627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b824d890fb742a0b9a6eaf5876929a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.600421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b824d890fb742a0b9a6eaf5876929a1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:29.626336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1109/2211] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:29 2022] DELETE /identity/v3/users/9b824d890fb742a0b9a6eaf5876929a1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:30.008598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:30.010269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:30.024464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fc4ae-a72d-47a5-a5cd-155a85b299a3 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:30.082378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:30.083655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:30.084195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:30.084481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] PATH_INFO: `/v3/projects/7905293f7c7847ca89712cec0975c84d` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:30.085670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7905293f7c7847ca89712cec0975c84d)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:30.087583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:30.098568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:30.197244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7905293f7c7847ca89712cec0975c84d', 'request_id': 'req-ace623ff-fa91-4e38-8ca0-496365f5df94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.207831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7905293f7c7847ca89712cec0975c84d', 'request_id': 'req-ace623ff-fa91-4e38-8ca0-496365f5df94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.216231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7905293f7c7847ca89712cec0975c84d', 'request_id': 'req-ace623ff-fa91-4e38-8ca0-496365f5df94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.309411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] The token cache is being invalidate because project 7905293f7c7847ca89712cec0975c84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:30.309974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.310596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.312483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1103/2212] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:30 2022] DELETE /identity/v3/projects/7905293f7c7847ca89712cec0975c84d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:30.316461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:30.318885 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:30.328939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:30.334463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9aeb3-2e7b-480f-9fca-9fde2cd7ea35 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:30.344974 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:30.346563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:30.403324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:30.403977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:30.404260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:30.404680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] PATH_INFO: `/v3/users/9748d54e24d24b40a1ace83e97d13fb2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:30.405908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9748d54e24d24b40a1ace83e97d13fb2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:30.407923 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:30.420308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace623ff-fa91-4e38-8ca0-496365f5df94 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:30.425632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:30.426249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:30.426526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:30.427428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:30.429256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:30.441258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:30.449141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:30.453645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1104/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:30.570034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9748d54e24d24b40a1ace83e97d13fb2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.639064 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9748d54e24d24b40a1ace83e97d13fb2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.647883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9748d54e24d24b40a1ace83e97d13fb2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.648580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9748d54e24d24b40a1ace83e97d13fb2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.649280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e17847a1-4423-4782-a2c5-5c1e6e96fd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9748d54e24d24b40a1ace83e97d13fb2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:30.669418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1110/2214] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:30 2022] DELETE /identity/v3/users/9748d54e24d24b40a1ace83e97d13fb2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:31.095190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:31.096623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:31.121507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d323af6-835d-4e08-89d6-a3e15fe4723a service placement] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:31.188902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:31.189536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:31.189836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:31.190114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] PATH_INFO: `/v3/projects/d80d03777af040999290ca6f7a950da1` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:31.191260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80d03777af040999290ca6f7a950da1)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:31.193864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:31.321164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:31.332604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80d03777af040999290ca6f7a950da1', 'request_id': 'req-e91bf839-6a9a-49b6-8746-94f178126d8f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:31.338903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80d03777af040999290ca6f7a950da1', 'request_id': 'req-e91bf839-6a9a-49b6-8746-94f178126d8f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:31.344463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80d03777af040999290ca6f7a950da1', 'request_id': 'req-e91bf839-6a9a-49b6-8746-94f178126d8f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:31.438037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] The token cache is being invalidate because project d80d03777af040999290ca6f7a950da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:31.438411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:31.439184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:31.441064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1105/2215] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:31 2022] DELETE /identity/v3/projects/d80d03777af040999290ca6f7a950da1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:36.354538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:36.355031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:36.355130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:36.374222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:36.375451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:36.430863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1111/2216] 10.222.0.60 () {58 vars in 967 bytes} [Wed Jul 27 08:42:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:36.453694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:36.455221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:36.533732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf839-6a9a-49b6-8746-94f178126d8f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:36.538717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcbd71-27f4-446b-aec7-6174a1b634f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:36.539365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcbd71-27f4-446b-aec7-6174a1b634f4 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:36.539797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcbd71-27f4-446b-aec7-6174a1b634f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:36.540077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcbd71-27f4-446b-aec7-6174a1b634f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:36.548306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcbd71-27f4-446b-aec7-6174a1b634f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:36.552942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcbd71-27f4-446b-aec7-6174a1b634f4 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:36.558134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1106/2217] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:42:37.567578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:37.571507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:37.602210 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:37.636033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c3dfe-ad95-4a8e-891a-340c4ffede24 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:37.640879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:37.641630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:37.641913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:37.642195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] PATH_INFO: `/v3/users/9c43a138fd9b438d9719f8fd9fe80467` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:37.643413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c43a138fd9b438d9719f8fd9fe80467)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:37.645447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:37.923643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c43a138fd9b438d9719f8fd9fe80467'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.012268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c43a138fd9b438d9719f8fd9fe80467'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.019482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c43a138fd9b438d9719f8fd9fe80467'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.020109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c43a138fd9b438d9719f8fd9fe80467'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.020713 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c43a138fd9b438d9719f8fd9fe80467'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.038468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1112/2218] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:42:37 2022] DELETE /identity/v3/users/9c43a138fd9b438d9719f8fd9fe80467 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:38.043144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:38.043624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:38.043729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:38.062382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:38.063593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:38.122670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1107/2219] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:38.132352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:38.134325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:38.192446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a05e-0b1b-4332-b618-61983d0134c8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:38.196485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce70bf-fd07-42ef-aeb9-247a709c93b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:38.197131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce70bf-fd07-42ef-aeb9-247a709c93b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:38.197411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce70bf-fd07-42ef-aeb9-247a709c93b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:38.197681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce70bf-fd07-42ef-aeb9-247a709c93b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:38.206274 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce70bf-fd07-42ef-aeb9-247a709c93b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:38.207697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce70bf-fd07-42ef-aeb9-247a709c93b0 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:38.217543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1113/2220] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:38.626434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:38.627994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:38.644061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f371b-351b-4df0-9b67-e2fa8506c8b7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:38.651342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:38.652008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:38.652296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:38.652578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] PATH_INFO: `/v3/projects/51a4f53f53764e0a9fe9a54b562462b5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:38.653844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a4f53f53764e0a9fe9a54b562462b5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:38.655822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:38.747956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:38.750813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a4f53f53764e0a9fe9a54b562462b5', 'request_id': 'req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.756934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a4f53f53764e0a9fe9a54b562462b5', 'request_id': 'req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.762583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a4f53f53764e0a9fe9a54b562462b5', 'request_id': 'req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.828410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] The token cache is being invalidate because project 51a4f53f53764e0a9fe9a54b562462b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:42:38.828701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.829369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-aa9b00c7-909c-4dc4-92e5-19b7638c24c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:42:38.830872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1108/2221] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:42:38 2022] DELETE /identity/v3/projects/51a4f53f53764e0a9fe9a54b562462b5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:38.837607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:38.838118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:38.838234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:38.858212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:38.859404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:38.902764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:38.918179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1114/2222] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:38.926212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:38.926504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:38.926785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:38.947254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:38.948561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:38.956599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1109/2223] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:38.960876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:38.970541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0499e35-a23e-4789-9815-fe84c9477563 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:38.975273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:38.975866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:38.976142 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:38.976978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:38.977711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:42:38.978010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:38.979593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:38.991234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1115/2224] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:42:38.996119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:39.005545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ca405-b6b7-440c-8776-507fb1b00b0e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:39.010210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:39.010813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.011099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.011378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.012238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:39.014166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:39.120468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1110/2225] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:39.124571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:39.134762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3082db4-aa56-4e0c-bf66-71a593831e38 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:39.189966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:39.190580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.190864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.191136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.191794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:39.193759 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:39.309958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1116/2226] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:39 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:39.314043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:39.324752 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dec35-9dfd-44b7-ab4a-5e006a4b8ac2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:39.329404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:39.330012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.330301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.330581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.331275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:39.332903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:39.343349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1111/2227] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:39.347202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:39.358065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54263-dca1-4f09-bcd9-1dbd09b80844 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:39.362681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293259f-653a-42ab-ac79-11af9cc37bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:39.363285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293259f-653a-42ab-ac79-11af9cc37bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.363566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293259f-653a-42ab-ac79-11af9cc37bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.363841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293259f-653a-42ab-ac79-11af9cc37bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.364528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293259f-653a-42ab-ac79-11af9cc37bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:39.366141 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293259f-653a-42ab-ac79-11af9cc37bc2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:39.376617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1117/2228] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:39.380753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:39.391252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff310b-c674-438e-b7c2-7dd388bc3869 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:39.395760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:39.396410 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.396692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.397001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] PATH_INFO: `/v3/projects/76b34f05485142d2876a7d9e6e7e3126/users/aada52c9ee894a848cd7588d06c3017f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.411545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b34f05485142d2876a7d9e6e7e3126, user_id=aada52c9ee894a848cd7588d06c3017f, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:39.414282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:39.525738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1112/2229] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:39 2022] PUT /identity/v3/projects/76b34f05485142d2876a7d9e6e7e3126/users/aada52c9ee894a848cd7588d06c3017f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:39.530816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d766-fb09-4031-87fa-f0e858313c06 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.531100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d766-fb09-4031-87fa-f0e858313c06 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.531372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d766-fb09-4031-87fa-f0e858313c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.550062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a878d766-fb09-4031-87fa-f0e858313c06 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:39.551243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a878d766-fb09-4031-87fa-f0e858313c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:39.608050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1118/2230] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:39.618178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:39.619883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:39.676617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf8b53-4527-49a1-9380-0316c80c598a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:39.680325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:39.680961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:39.681247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:39.681524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:39.690567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:39.695765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:39.702640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1113/2231] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:42:45.014468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.015012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.015012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.046349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] MFA Rules not processed for user `aada52c9ee894a848cd7588d06c3017f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:45.047651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:45.099498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:45.122523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1119/2232] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:42:45.127226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:45.138120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965db96-dd86-4897-b870-679ebceee442 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:45.142977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:45.143930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.143930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.144138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.144963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:45.146878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:45.232088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1114/2233] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:42:45 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:45.236329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:45.248231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40abe-ba35-458a-a716-12828bbb9e35 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:45.308504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:45.309332 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.309621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.309896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.310567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:45.312541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:45.430826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1120/2234] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:42:45 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:42:45.434775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:45.445053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c40e5-958a-443a-86ee-f83a301df43b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:45.451653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:45.451653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.451653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.451653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.452074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:45.453692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:45.464884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1115/2235] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:45.469075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:45.480239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53bad-1ace-4cb5-89fe-773bf114b033 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:45.484956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:45.485615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.485900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.486178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] PATH_INFO: `/v3/projects/d8bd07ebebf24782aa153b7b41465862/users/a591babdffe04db4b60b98fc9f7b0c94/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.502660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bd07ebebf24782aa153b7b41465862, user_id=a591babdffe04db4b60b98fc9f7b0c94, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:45.505373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:45.576412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1121/2236] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:45 2022] PUT /identity/v3/projects/d8bd07ebebf24782aa153b7b41465862/users/a591babdffe04db4b60b98fc9f7b0c94/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:45.580349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:45.590304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ddb23-b02d-4b18-84be-b44294196889 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:45.630982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:45.648664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a882a2-6c7a-492e-a6f3-c709db0ca6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:45.649437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a882a2-6c7a-492e-a6f3-c709db0ca6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.649718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a882a2-6c7a-492e-a6f3-c709db0ca6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.649992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a882a2-6c7a-492e-a6f3-c709db0ca6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.650670 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a882a2-6c7a-492e-a6f3-c709db0ca6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:45.652254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a882a2-6c7a-492e-a6f3-c709db0ca6d9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:45.662332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1116/2237] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:42:45.667531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:45.677833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18511-65be-4520-afcf-7c9e4c7fed71 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:45.683176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:45.683853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:45.684139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:45.684415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] PATH_INFO: `/v3/projects/d8bd07ebebf24782aa153b7b41465862/users/a591babdffe04db4b60b98fc9f7b0c94/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:45.686388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bd07ebebf24782aa153b7b41465862, user_id=a591babdffe04db4b60b98fc9f7b0c94, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:45.689165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:45.699920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1122/2238] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:42:45 2022] PUT /identity/v3/projects/d8bd07ebebf24782aa153b7b41465862/users/a591babdffe04db4b60b98fc9f7b0c94/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:42:51.539805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f362237-2dc1-480f-a261-2de4e18485ce None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:51.540325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f362237-2dc1-480f-a261-2de4e18485ce None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:51.540567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f362237-2dc1-480f-a261-2de4e18485ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:51.576117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3f362237-2dc1-480f-a261-2de4e18485ce None None] MFA Rules not processed for user `a591babdffe04db4b60b98fc9f7b0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:51.577385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3f362237-2dc1-480f-a261-2de4e18485ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:51.675910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1117/2239] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:42:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:51.692340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:51.694281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:51.764390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39492f52-6aff-4dd7-b04b-1322835e4a80 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:51.770205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:51.770205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:51.770205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:51.770205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:51.826040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:51.837968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:51.839744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:51.849732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1123/2240] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:42:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:42:52.151835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60b0d9-f435-47f1-ace0-f13dc2832fe1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:52.152129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60b0d9-f435-47f1-ace0-f13dc2832fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:52.152405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60b0d9-f435-47f1-ace0-f13dc2832fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:52.172270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-aa60b0d9-f435-47f1-ace0-f13dc2832fe1 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:42:52.173488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-aa60b0d9-f435-47f1-ace0-f13dc2832fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:52.238828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1118/2241] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:42:52.253624 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:42:52.255120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:42:52.334148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401185e-17b8-4f94-af5e-b94e207fbf71 service glance] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:42:52.339813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3499-e23c-4033-96ab-5223cc8d0321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:42:52.340437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3499-e23c-4033-96ab-5223cc8d0321 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:42:52.340741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3499-e23c-4033-96ab-5223cc8d0321 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:42:52.341024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3499-e23c-4033-96ab-5223cc8d0321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:42:52.349392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3499-e23c-4033-96ab-5223cc8d0321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:42:52.351253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3499-e23c-4033-96ab-5223cc8d0321 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:42:52.359585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1124/2242] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:43:02.232786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=70 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:02.356335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=36 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:04.432177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:04.432177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:04.432177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:04.450404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] MFA Rules not processed for user `aada52c9ee894a848cd7588d06c3017f`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:43:04.451770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:04.459137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1119/2243] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:43:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:43:08.124286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb89d59-d6ac-40f5-9b90-216ecea6b6d8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:08.124911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb89d59-d6ac-40f5-9b90-216ecea6b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:08.124911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb89d59-d6ac-40f5-9b90-216ecea6b6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:08.144405 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ddb89d59-d6ac-40f5-9b90-216ecea6b6d8 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:43:08.145649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ddb89d59-d6ac-40f5-9b90-216ecea6b6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:08.153426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1125/2244] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:43:08.166479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:43:08.178932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e975b-b634-4922-af4f-d6b533088e36 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:43:08.185078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd241-2616-4b58-8a35-1ffa6a8fd9a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:43:08.185705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd241-2616-4b58-8a35-1ffa6a8fd9a2 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:08.186129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd241-2616-4b58-8a35-1ffa6a8fd9a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:08.186409 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd241-2616-4b58-8a35-1ffa6a8fd9a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:08.194901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd241-2616-4b58-8a35-1ffa6a8fd9a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:43:08.196912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd241-2616-4b58-8a35-1ffa6a8fd9a2 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:43:08.208093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1120/2245] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:43:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:43:11.501099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8b24-1bc1-4123-b5a1-1932f9ec7014 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:11.508441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8b24-1bc1-4123-b5a1-1932f9ec7014 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:11.508441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc8b24-1bc1-4123-b5a1-1932f9ec7014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:11.522229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5bbc8b24-1bc1-4123-b5a1-1932f9ec7014 None None] MFA Rules not processed for user `f5ab7ab8489b45c3af75187da20695af`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:43:11.523449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5bbc8b24-1bc1-4123-b5a1-1932f9ec7014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:11.586006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1126/2246] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:43:18.203540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:21.577982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=28 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:30.075437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:30.075933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:30.076052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:30.116673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] MFA Rules not processed for user `63fa285fd1e14d41977a6cd0ceaabb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:43:30.128953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:30.245705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1121/2247] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:43:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:43:33.573718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc5401-e728-4719-8623-a1b85f989c18 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:33.574206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc5401-e728-4719-8623-a1b85f989c18 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:33.574304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc5401-e728-4719-8623-a1b85f989c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:33.598853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c3dc5401-e728-4719-8623-a1b85f989c18 None None] MFA Rules not processed for user `a1303857db364b2991017d1a39d8f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:43:33.598853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3dc5401-e728-4719-8623-a1b85f989c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:33.651431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1127/2248] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:43:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:43:37.456065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:43:37.457540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:37.531874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e1dc-9f5a-442b-b518-fa4e061a00c7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:43:37.535580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:43:37.536262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:37.536544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:37.536849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:37.548294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:43:37.553458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:43:37.562022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1122/2249] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:43:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:43:43.644627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=25 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:47.556332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=51 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:55.260437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:43:55.262211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:43:55.262211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:43:55.281267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] MFA Rules not processed for user `4d4013ba9eca412b81585544a52e38ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:43:55.282497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:43:55.336857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1128/2250] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:05.329362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=25 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:31.315101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:31.324275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a872c6-1803-4f3c-9be5-e106fe44b761 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:31.328035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:31.328710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:31.329020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:31.329291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:31.331064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:31.401660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:31.403162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b26fb-1aec-4ce7-87c9-d58e5aa2e432 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:31.414089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1123/2251] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:44:34.403602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:34.413234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1812-2538-42f1-9c58-b7ea5f2db1b2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:34.417244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:34.417861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:34.418144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:34.418424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:34.420179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:34.434262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:34.435749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:34.447052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1129/2252] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:44:39.146467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:39.146999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:39.147097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:39.166520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] MFA Rules not processed for user `f5ab7ab8489b45c3af75187da20695af`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:39.167762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:39.174904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1124/2253] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:41.948536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:41.957888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d238d2-e2e4-4110-ae5e-14972870c117 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:41.961636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:41.962310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:41.962854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:41.963331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:41.965555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:42.049233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:42.053032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:42.061228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1130/2254] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:44:44.367357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:44.370084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:44.393846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddad05-351a-4303-a422-3e131a15a0ac None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:44.408946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:44.408946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:44.408946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:44.408946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:44.409305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:44.417796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:44.419477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:44.429041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1125/2255] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:44:47.194259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:47.195714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:47.208694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac5f5-9436-457e-9fc6-90387eee8764 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:47.213607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:47.214255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:47.214540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:47.214819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] PATH_INFO: `/v3/users/63fa285fd1e14d41977a6cd0ceaabb64` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:47.215998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fa285fd1e14d41977a6cd0ceaabb64)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:47.218005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:47.397892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fa285fd1e14d41977a6cd0ceaabb64'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.492545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fa285fd1e14d41977a6cd0ceaabb64'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.500099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fa285fd1e14d41977a6cd0ceaabb64'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.504103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fa285fd1e14d41977a6cd0ceaabb64'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.504103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d9430ac4-9de7-4d47-bc05-ee6f00e76bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fa285fd1e14d41977a6cd0ceaabb64'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.519468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1131/2256] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:44:47 2022] DELETE /identity/v3/users/63fa285fd1e14d41977a6cd0ceaabb64 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:47.757504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:47.769109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe65f-de2a-476a-9707-c13b1db73f3e service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:47.827699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:47.828384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:47.828673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:47.829136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] PATH_INFO: `/v3/projects/3bd839a24c7a4f82903847fe48b83da5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:47.830311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd839a24c7a4f82903847fe48b83da5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:47.832280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:47.954319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd839a24c7a4f82903847fe48b83da5', 'request_id': 'req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.961119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd839a24c7a4f82903847fe48b83da5', 'request_id': 'req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.969772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd839a24c7a4f82903847fe48b83da5', 'request_id': 'req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:47.973931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:48.043518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] The token cache is being invalidate because project 3bd839a24c7a4f82903847fe48b83da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:44:48.043816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:48.044538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a1acdb2e-d7f9-4c62-a1e1-d2d6ea580cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:48.046508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1126/2257] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:44:47 2022] DELETE /identity/v3/projects/3bd839a24c7a4f82903847fe48b83da5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:48.058356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.059178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.059465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.087704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:48.089044 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:48.137330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:48.149991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1132/2258] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:48.157407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.157702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.157986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.178129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:48.179343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:48.188341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1127/2259] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:44:48.192710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.203742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f395b-9c7d-4b1e-b73d-8ccda33609c2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.208790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.209410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.209691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.209964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.210715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:44:48.211025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:48.212708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:48.224569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1133/2260] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:44:48.229365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.238535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa12ea-b568-402a-9b61-1888786b4714 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.243144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.243744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.244648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.244936 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.245631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:48.247505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:48.338614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1128/2261] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:44:48 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:48.340093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.350102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0fb20-d998-4064-8d8f-db4e78383ba4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.413879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.414545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.414832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.415105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.416038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:48.417890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:48.540457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1134/2262] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:44:48 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:48.543984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.554230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad013e2-c4a0-49a5-a0db-39bb1f22b3aa admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.559454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.560066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.560354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.560633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.561389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:48.562985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:48.572897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1129/2263] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:48.576862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.587716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb71e-e3cb-428b-8cbd-dbcf58799c85 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.594213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed159b-c7b8-4e7c-8859-8b431ae699b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.594852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed159b-c7b8-4e7c-8859-8b431ae699b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.595138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed159b-c7b8-4e7c-8859-8b431ae699b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.595415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed159b-c7b8-4e7c-8859-8b431ae699b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.596109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed159b-c7b8-4e7c-8859-8b431ae699b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:48.597736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed159b-c7b8-4e7c-8859-8b431ae699b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:48.609501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1135/2264] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:48.613523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.624088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78e57f-a253-41b4-adda-c5281f8bd869 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.628629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.629314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.629602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.629883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] PATH_INFO: `/v3/projects/2b7d64c3ce984ed4a171645e7aa9bebb/users/b92be60c09524dbd9a73e33665cb3d19/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.644132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d64c3ce984ed4a171645e7aa9bebb, user_id=b92be60c09524dbd9a73e33665cb3d19, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:48.646824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:48.831022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1130/2265] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:44:48 2022] PUT /identity/v3/projects/2b7d64c3ce984ed4a171645e7aa9bebb/users/b92be60c09524dbd9a73e33665cb3d19/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:48.836162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.836468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.836758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:48.857191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:48.858455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:48.918612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1136/2266] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:48.928371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:48.931028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:48.988901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3eba-df21-4436-8001-948f2959cc3b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:48.992533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f7e52-8410-4d2e-b3f4-2af815da8273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:48.993204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7e52-8410-4d2e-b3f4-2af815da8273 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:48.993493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7e52-8410-4d2e-b3f4-2af815da8273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:48.993796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7e52-8410-4d2e-b3f4-2af815da8273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:49.002780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7e52-8410-4d2e-b3f4-2af815da8273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:49.004203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7e52-8410-4d2e-b3f4-2af815da8273 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:49.013765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1131/2267] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:44:49.097538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:49.099310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:49.160972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:49.177107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae2f0-0c76-4c52-9d96-3d9b191cb9eb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:49.182838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:49.185761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:49.185761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:49.185761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:49.186092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:49.245119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:49.246767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:49.255686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1137/2268] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:44:50.284417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:50.285012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:50.285012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:50.318451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] MFA Rules not processed for user `b92be60c09524dbd9a73e33665cb3d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:50.319671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:50.395222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1132/2269] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:44:50.405129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:50.415441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd7ca5-fa22-4f8d-9440-cc8334bec3cd service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:50.421022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:50.428336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:50.428336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:50.428336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:50.428336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:50.428336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:50.529966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1138/2270] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:44:50 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:50.530268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:50.544114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7586-9097-4904-9a2f-ecd2279c46e5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:50.567891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:50.608621 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:50.609270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:50.609548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:50.609817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:50.610485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:50.612412 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:50.716878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1133/2271] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:44:50 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:50.720957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:50.732468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29b4c9-efc4-426f-8ca2-4b5e80c06475 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:50.737243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:50.737872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:50.741091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:50.741091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:50.741091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:50.741091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:50.752289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1139/2272] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:50.756547 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:50.767893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffa131-ca28-4a1e-876b-8ec1ff2a8fc4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:50.772661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:50.775886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:50.775886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:50.775886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] PATH_INFO: `/v3/projects/907e2c695f874cefabc6ebb0d359eeb2/users/de76ed1e2f8a4c75805af386168ce3b5/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:50.789571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907e2c695f874cefabc6ebb0d359eeb2, user_id=de76ed1e2f8a4c75805af386168ce3b5, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:50.792586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:50.899322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1134/2273] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:44:50 2022] PUT /identity/v3/projects/907e2c695f874cefabc6ebb0d359eeb2/users/de76ed1e2f8a4c75805af386168ce3b5/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:50.904652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:50.915160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018739dd-6cd7-4e72-8a26-e364fd536a22 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:50.973749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b2bd-5363-4217-ab60-8e2dc4fb8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:50.974379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b2bd-5363-4217-ab60-8e2dc4fb8584 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:50.974663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b2bd-5363-4217-ab60-8e2dc4fb8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:50.974939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b2bd-5363-4217-ab60-8e2dc4fb8584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:50.975882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206b2bd-5363-4217-ab60-8e2dc4fb8584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:50.977528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206b2bd-5363-4217-ab60-8e2dc4fb8584 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:50.988122 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1140/2274] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:50.992373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:51.002876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1834a2-1ac1-4b2b-a5ee-3d794c6c8a97 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:51.007566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:51.008225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:51.008513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:51.008829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] PATH_INFO: `/v3/projects/907e2c695f874cefabc6ebb0d359eeb2/users/de76ed1e2f8a4c75805af386168ce3b5/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:51.011046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907e2c695f874cefabc6ebb0d359eeb2, user_id=de76ed1e2f8a4c75805af386168ce3b5, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:51.013726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:51.023684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1135/2275] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:44:50 2022] PUT /identity/v3/projects/907e2c695f874cefabc6ebb0d359eeb2/users/de76ed1e2f8a4c75805af386168ce3b5/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:52.210539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:52.211477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:52.211930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:52.245026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] MFA Rules not processed for user `de76ed1e2f8a4c75805af386168ce3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:52.246480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:52.297313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:52.320201 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1141/2276] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:53.746191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:53.820364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ccf77-23bf-46e7-a82e-934bf71606b9 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:53.826441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:53.827098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:53.827388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:53.828487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] PATH_INFO: `/v3/users/b92be60c09524dbd9a73e33665cb3d19` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:53.828927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92be60c09524dbd9a73e33665cb3d19)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:53.831009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:54.029444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92be60c09524dbd9a73e33665cb3d19'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.031681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92be60c09524dbd9a73e33665cb3d19'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.039493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92be60c09524dbd9a73e33665cb3d19'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.054841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92be60c09524dbd9a73e33665cb3d19'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.055664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92be60c09524dbd9a73e33665cb3d19'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.060535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:54.173388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1136/2277] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:44:53 2022] DELETE /identity/v3/users/b92be60c09524dbd9a73e33665cb3d19 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:54.444777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:54.458259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72beaff-420f-46e2-9bbe-d512d149e637 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:54.490914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:54.496382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:54.543536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:54.544244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:54.544704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:54.544995 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] PATH_INFO: `/v3/projects/2b7d64c3ce984ed4a171645e7aa9bebb` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:54.546485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7d64c3ce984ed4a171645e7aa9bebb)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:54.548786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:54.602564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa414c4-f0b8-4bd8-be27-9822e1bed55e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:54.608766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:54.609419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:54.609702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:54.610397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:54.611790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:54.669453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7d64c3ce984ed4a171645e7aa9bebb', 'request_id': 'req-3912d23d-fa92-435b-9a76-20494a7f1a75'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.677921 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7d64c3ce984ed4a171645e7aa9bebb', 'request_id': 'req-3912d23d-fa92-435b-9a76-20494a7f1a75'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.685111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7d64c3ce984ed4a171645e7aa9bebb', 'request_id': 'req-3912d23d-fa92-435b-9a76-20494a7f1a75'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.689107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:54.691976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:54.712915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1137/2278] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:44:54.771327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] The token cache is being invalidate because project 2b7d64c3ce984ed4a171645e7aa9bebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:44:54.771819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.772889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:54.774364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1142/2279] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:44:54 2022] DELETE /identity/v3/projects/2b7d64c3ce984ed4a171645e7aa9bebb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:54.779302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:54.780891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:54.797548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b041-4598-4381-bf0e-de7bdd6a50ea service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:54.862418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:54.863076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:54.863356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:54.863632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] PATH_INFO: `/v3/users/de76ed1e2f8a4c75805af386168ce3b5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:54.865727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de76ed1e2f8a4c75805af386168ce3b5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:54.867985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:55.128788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:55.147598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de76ed1e2f8a4c75805af386168ce3b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.149730 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de76ed1e2f8a4c75805af386168ce3b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.181606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de76ed1e2f8a4c75805af386168ce3b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.203518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de76ed1e2f8a4c75805af386168ce3b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.204124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36e1bd2c-69c4-4670-b562-ed13c6070c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de76ed1e2f8a4c75805af386168ce3b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.307074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1138/2280] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:44:54 2022] DELETE /identity/v3/users/de76ed1e2f8a4c75805af386168ce3b5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:55.672539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:55.674065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:55.687133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912d23d-fa92-435b-9a76-20494a7f1a75 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:55.748654 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:55.749495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:55.749780 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:55.750055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] PATH_INFO: `/v3/projects/907e2c695f874cefabc6ebb0d359eeb2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:55.751234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907e2c695f874cefabc6ebb0d359eeb2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:55.753217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:55.772097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:55.859534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907e2c695f874cefabc6ebb0d359eeb2', 'request_id': 'req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.865514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907e2c695f874cefabc6ebb0d359eeb2', 'request_id': 'req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.870810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907e2c695f874cefabc6ebb0d359eeb2', 'request_id': 'req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.926235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] The token cache is being invalidate because project 907e2c695f874cefabc6ebb0d359eeb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:44:55.926521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.927134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2c237225-8f3b-4a9d-bb2d-b3b4bd87c772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:44:55.928663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1143/2281] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:44:55 2022] DELETE /identity/v3/projects/907e2c695f874cefabc6ebb0d359eeb2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:55.933716 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:55.934193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:55.934296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:55.954148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:55.955526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:56.014503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1139/2282] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:44:56.022484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.022711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.023002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.043607 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:56.044856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:56.052588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1144/2283] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:56.056982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.066859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634488f-243e-42a4-be42-c8c8a02f8e55 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.071488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.072092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.072378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.072674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.073640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:44:56.073947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.075548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.086991 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1140/2284] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:44:56.091988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.101303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112c54-5ba2-43ec-afe3-0be34ed96221 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.106594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.107187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.107463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.107732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.108401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.110340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.196875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1145/2285] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:44:56 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:56.201530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.211597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cbb60-c46d-418a-bae9-66837b5a194c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.269175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.269789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.270070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.270343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.270996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.273006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.350210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1141/2286] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:44:56 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:56.354940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.365090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9731-b683-4702-8058-fb9b80a03bca admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.369609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.370235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.370518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.370802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.371505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.373120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.382918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1146/2287] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:44:56.387655 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.397826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e1905-5a76-47d6-ba9d-909389f3e1c5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.403090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703147f-9cc5-40e8-a939-1cbbe69797bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.403694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703147f-9cc5-40e8-a939-1cbbe69797bf admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.404009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703147f-9cc5-40e8-a939-1cbbe69797bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.404291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703147f-9cc5-40e8-a939-1cbbe69797bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.405026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703147f-9cc5-40e8-a939-1cbbe69797bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.406610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703147f-9cc5-40e8-a939-1cbbe69797bf admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.417145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1142/2288] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:56.421161 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.430815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2f50a-ed09-43c1-8b11-aa33c1217b08 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.435367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.436010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.436291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.436560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] PATH_INFO: `/v3/projects/5966de0dfcd3425e9635e4750f9c6ea0/users/f584de083e5a4b5193a442c53d683a8e/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.451102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5966de0dfcd3425e9635e4750f9c6ea0, user_id=f584de083e5a4b5193a442c53d683a8e, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.453783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.547094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1147/2289] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:44:56 2022] PUT /identity/v3/projects/5966de0dfcd3425e9635e4750f9c6ea0/users/f584de083e5a4b5193a442c53d683a8e/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:44:56.559703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.559993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.560293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.588291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] MFA Rules not processed for user `f584de083e5a4b5193a442c53d683a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:56.589927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:56.595074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:56.658175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1143/2290] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:44:56.663060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.738418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a1f0-1864-4a20-a91f-f3ab3fe95ed4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.743687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.744321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.745625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.745625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.746698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.749028 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:56.872625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1148/2291] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:44:56 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:56.877005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:56.888317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e011937-6161-4063-9f5e-2128bcdd9179 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:56.953376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:56.954047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:56.954330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:56.954602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:56.955263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:56.957206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:57.060035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1144/2292] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:44:56 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:44:57.064090 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:57.074401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2423c-0f77-464d-8e80-d4269d309dd0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:57.079063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:57.079666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:57.079948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:57.080253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:57.080999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:57.082585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:57.093307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1149/2293] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:57.097738 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:57.108808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a66277-e67d-43c0-93d8-9872f456438a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:57.113541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:57.114209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:57.119726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:57.119726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] PATH_INFO: `/v3/projects/0a33d4d6511648189c280dac30857184/users/6fdc3e6822ce42ff819c52e41e36f27b/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:57.130041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a33d4d6511648189c280dac30857184, user_id=6fdc3e6822ce42ff819c52e41e36f27b, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:57.132898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:57.190358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1145/2294] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:44:57 2022] PUT /identity/v3/projects/0a33d4d6511648189c280dac30857184/users/6fdc3e6822ce42ff819c52e41e36f27b/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:57.194366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:57.204596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569068c-82a0-4402-935a-f4d6bbaa1de7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:57.216788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:57.261652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4530fb-a15f-40b5-8e9a-08f256a2ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:57.263036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4530fb-a15f-40b5-8e9a-08f256a2ec75 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:57.263702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4530fb-a15f-40b5-8e9a-08f256a2ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:57.264037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4530fb-a15f-40b5-8e9a-08f256a2ec75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:57.264752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4530fb-a15f-40b5-8e9a-08f256a2ec75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:57.266379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4530fb-a15f-40b5-8e9a-08f256a2ec75 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:57.276596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1150/2295] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:44:57.280793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:57.290952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387533f-eb40-48aa-b3ff-cc8920b771a0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:57.296193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:57.296888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:57.297182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:57.297458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] PATH_INFO: `/v3/projects/0a33d4d6511648189c280dac30857184/users/6fdc3e6822ce42ff819c52e41e36f27b/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:57.299385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a33d4d6511648189c280dac30857184, user_id=6fdc3e6822ce42ff819c52e41e36f27b, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:57.302057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:57.312591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1146/2296] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:44:57 2022] PUT /identity/v3/projects/0a33d4d6511648189c280dac30857184/users/6fdc3e6822ce42ff819c52e41e36f27b/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:44:57.326941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fd94-17d0-43b0-a9e3-d8026616745a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:57.326941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fd94-17d0-43b0-a9e3-d8026616745a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:57.326941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fd94-17d0-43b0-a9e3-d8026616745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:57.359157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c3d0fd94-17d0-43b0-a9e3-d8026616745a None None] MFA Rules not processed for user `6fdc3e6822ce42ff819c52e41e36f27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:44:57.361098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c3d0fd94-17d0-43b0-a9e3-d8026616745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:57.434132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1151/2297] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:44:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:44:57.444940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:44:57.447539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:44:57.507763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db391c-c8cb-40f9-bc68-865759bd498e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:44:57.511523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:44:57.512149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:44:57.512430 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:44:57.512704 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:44:57.527060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:57.578819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:44:57.580256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:44:57.589873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1147/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:44:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:00.685838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecced9-06d6-4326-83f7-153526464616 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:00.686397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecced9-06d6-4326-83f7-153526464616 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:00.686397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecced9-06d6-4326-83f7-153526464616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:00.706192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-adecced9-06d6-4326-83f7-153526464616 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:00.707611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-adecced9-06d6-4326-83f7-153526464616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:00.764520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1152/2299] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:00.805353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:00.806782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:00.881669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f20c8-c367-4b89-921f-f9c4d8e8c476 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:00.887063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:00.887684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:00.887975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:00.888254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:00.896620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:00.898224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:00.906504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1148/2300] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:03.289918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecced9-06d6-4326-83f7-153526464616 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:03.301007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecced9-06d6-4326-83f7-153526464616 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:03.304904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01368c4-89ba-4fcc-9333-1da2aeeba9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:03.305663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01368c4-89ba-4fcc-9333-1da2aeeba9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:03.306081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01368c4-89ba-4fcc-9333-1da2aeeba9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:03.306635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01368c4-89ba-4fcc-9333-1da2aeeba9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:03.318703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01368c4-89ba-4fcc-9333-1da2aeeba9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:03.320604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01368c4-89ba-4fcc-9333-1da2aeeba9f5 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:03.337235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1153/2301] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:10.007756 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:10.085083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabd4ae-9378-40cd-b449-782bb38bd967 service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:10.091715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:10.092800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:10.093426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:10.093426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] PATH_INFO: `/v3/users/f584de083e5a4b5193a442c53d683a8e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:10.094589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f584de083e5a4b5193a442c53d683a8e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:10.096566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:10.354432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:10.357100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f584de083e5a4b5193a442c53d683a8e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:10.357814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f584de083e5a4b5193a442c53d683a8e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:10.365817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f584de083e5a4b5193a442c53d683a8e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:10.383849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f584de083e5a4b5193a442c53d683a8e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:10.385050 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f584de083e5a4b5193a442c53d683a8e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:10.882076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1149/2302] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:10 2022] DELETE /identity/v3/users/f584de083e5a4b5193a442c53d683a8e => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:10.892162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:10.892812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:10.892812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:10.911327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:10.912517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:10.935794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:10.969830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1154/2303] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:10.979918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:10.981559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:11.041186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb3a4f-68a8-4417-984e-efc024485d41 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:11.044922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:11.046042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:11.046317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:11.046593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:11.056024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:11.061884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:11.069516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1150/2304] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:11.709393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:11.711146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:11.739587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13032fc-3c47-4cf8-a34d-d4286131cf9d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:11.749814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:11.750397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:11.750683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:11.750962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] PATH_INFO: `/v3/projects/5966de0dfcd3425e9635e4750f9c6ea0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:11.753066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5966de0dfcd3425e9635e4750f9c6ea0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:11.755490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:11.893953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:11.895774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:11.939988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5966de0dfcd3425e9635e4750f9c6ea0', 'request_id': 'req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:11.995979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5966de0dfcd3425e9635e4750f9c6ea0', 'request_id': 'req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.006452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5966de0dfcd3425e9635e4750f9c6ea0', 'request_id': 'req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.072072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731008-1d7a-4c25-b19a-360108eb57c7 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:12.126667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] The token cache is being invalidate because project 5966de0dfcd3425e9635e4750f9c6ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:12.127056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.131428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.134052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1155/2305] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:11 2022] DELETE /identity/v3/projects/5966de0dfcd3425e9635e4750f9c6ea0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:12.135562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:12.137542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:12.169569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:12.180514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:12.181332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:12.181453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:12.182109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:12.183763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:12.197539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:12.199163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:12.219196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1151/2306] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:12.226813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e60d-50b8-4dd3-aa5b-5e77cb6ac126 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:12.247535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:12.248347 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:12.248973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:12.249448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] PATH_INFO: `/v3/users/6fdc3e6822ce42ff819c52e41e36f27b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:12.250840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdc3e6822ce42ff819c52e41e36f27b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:12.253102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:12.442942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdc3e6822ce42ff819c52e41e36f27b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.502555 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdc3e6822ce42ff819c52e41e36f27b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.504143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:12.511691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdc3e6822ce42ff819c52e41e36f27b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.512636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdc3e6822ce42ff819c52e41e36f27b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.513396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdc3e6822ce42ff819c52e41e36f27b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:12.532145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1156/2307] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:12 2022] DELETE /identity/v3/users/6fdc3e6822ce42ff819c52e41e36f27b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:12.947868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:12.960699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424a1f-1fa3-4a5c-bbef-d16204909314 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.043978 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.044631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.044999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.045286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] PATH_INFO: `/v3/projects/0a33d4d6511648189c280dac30857184` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.047269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a33d4d6511648189c280dac30857184)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.049415 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.151040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.152455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:13.169448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a33d4d6511648189c280dac30857184', 'request_id': 'req-d54090b0-18aa-4c92-931e-17124e1360fc'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:13.177733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a33d4d6511648189c280dac30857184', 'request_id': 'req-d54090b0-18aa-4c92-931e-17124e1360fc'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:13.184534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a33d4d6511648189c280dac30857184', 'request_id': 'req-d54090b0-18aa-4c92-931e-17124e1360fc'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:13.220234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b49f9-cbe0-48d8-b785-cb24149d2eff admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.263019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] The token cache is being invalidate because project 0a33d4d6511648189c280dac30857184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:13.263384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:13.265471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d54090b0-18aa-4c92-931e-17124e1360fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:13.273595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1152/2308] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:12 2022] DELETE /identity/v3/projects/0a33d4d6511648189c280dac30857184 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:13.276242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.276242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.276242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.300621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.301676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.301822 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:13.302312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.302797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.303089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:13.309233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:13.319620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.322257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f01173-9716-44e5-afd6-526bcf65981c service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.338111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1157/2309] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:13.385113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1153/2310] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:13.394815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.394815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.394815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.416638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:13.418018 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:13.427503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1158/2311] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:13.431706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.442901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43496fba-b77b-4165-bac9-30917b6519e2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.452013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.452943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.453397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.453828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.454560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:13.454875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.456500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.470418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1154/2312] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:13.474997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.487266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d314f08-a2d5-4935-8fd8-f4499e16223a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.492370 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.493167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.493590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.493935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.494674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.497051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.586835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1159/2313] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:13 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:13.590744 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.603100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede6b3-30a6-4141-b79e-5471205dead2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.609523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:13.698885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.699847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.700694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.701150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.704695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.706842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.825651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1155/2314] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:13 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:13.826538 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.841378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace727e3-6a58-4d1d-a3dd-5d8bcebfd21e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.854754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.855451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.855743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.856015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.856755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.861575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.887245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1160/2315] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:13.889801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.904304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dd3fd-5816-4e69-9c05-c24d308b8b34 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.913942 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37c89-8f9a-464f-8fa3-2b371ef22936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.914679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37c89-8f9a-464f-8fa3-2b371ef22936 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.915028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37c89-8f9a-464f-8fa3-2b371ef22936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.915365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37c89-8f9a-464f-8fa3-2b371ef22936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.916136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37c89-8f9a-464f-8fa3-2b371ef22936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.917880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37c89-8f9a-464f-8fa3-2b371ef22936 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:13.930296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1156/2316] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:13.934657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:13.948119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70639e-09e8-4ef3-9af3-54153af66dc8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:13.953266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:13.954001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:13.954378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:13.954703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] PATH_INFO: `/v3/projects/3b036853057d4baa9f4c5257ec5981e7/users/d5a072cb48104047bd3d7d633af00d49/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:13.971742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b036853057d4baa9f4c5257ec5981e7, user_id=d5a072cb48104047bd3d7d633af00d49, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:13.975219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:14.056873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1161/2317] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:13 2022] PUT /identity/v3/projects/3b036853057d4baa9f4c5257ec5981e7/users/d5a072cb48104047bd3d7d633af00d49/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:14.070682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.071282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.071491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.112200 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] MFA Rules not processed for user `d5a072cb48104047bd3d7d633af00d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:14.112706 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:14.226877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1157/2318] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:14.231656 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:14.294786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:14.338428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f574b4f-3cde-4bca-9653-6283ae80a678 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:14.344387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:14.345207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.346329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.346329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.346979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:14.349813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:14.467794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1162/2319] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:14 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:14.469149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:14.481533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68ffd2-6935-4c45-b9cd-e9018b2c9711 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:14.567660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:14.568551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.568987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.571880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.571880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:14.572093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:14.682960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1158/2320] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:14 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:14.687611 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:14.699196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b4df-1170-4fb0-a5c6-fe4a5f6aac9f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:14.706070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:14.706914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.707284 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.707650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.708556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:14.710273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:14.723509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1163/2321] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:14.727749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:14.737328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:14.741300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e262114-7c44-44fb-8947-286a1a4aea97 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:14.747029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2443f-7757-4462-985a-97fe7a1ecf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:14.747029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2443f-7757-4462-985a-97fe7a1ecf57 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.751471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2443f-7757-4462-985a-97fe7a1ecf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.751471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2443f-7757-4462-985a-97fe7a1ecf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.751471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2443f-7757-4462-985a-97fe7a1ecf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:14.751471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2443f-7757-4462-985a-97fe7a1ecf57 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:14.764870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1159/2322] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:14.767794 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:14.785782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2eb90-2635-427d-8f97-fe4f86a24412 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:14.788425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:14.789244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.789595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.789949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] PATH_INFO: `/v3/projects/b8f34c16c4b04ad89b08c645c3eaccee/users/b4e66e089fcd4934ac1b67255a6e120c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.814418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f34c16c4b04ad89b08c645c3eaccee, user_id=b4e66e089fcd4934ac1b67255a6e120c, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:14.814418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:14.887633 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1164/2323] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:14 2022] PUT /identity/v3/projects/b8f34c16c4b04ad89b08c645c3eaccee/users/b4e66e089fcd4934ac1b67255a6e120c/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:14.898862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:14.899154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:14.899465 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:14.931957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] MFA Rules not processed for user `b4e66e089fcd4934ac1b67255a6e120c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:14.933313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:15.003557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1160/2324] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:15.008393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.092109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0dfcd-c613-4a10-aab6-2f7cfc521e8b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.097720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.098541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.104396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.104396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.104396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.104396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.195492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1165/2325] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:15 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:15.196700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.208053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3f9ee-248f-4e73-a7bb-937a086590d8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.272578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.273537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.273647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.273886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.274561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.276548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.386196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1161/2326] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:15 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:15.390957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.403394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89511d-dbb9-4d66-94c6-c1ef6b1e9a36 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.409777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.410593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.411171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.411686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.412896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.415559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.431033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1166/2327] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:15.441091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.452620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7551-f1d8-4ed2-a440-a302d48b4063 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.459299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.460092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.460504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.460909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] PATH_INFO: `/v3/projects/c991bc57e69a4fcfa0d213076e7ce2a0/users/4b13788277af4310812da663966a7de6/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.478117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c991bc57e69a4fcfa0d213076e7ce2a0, user_id=4b13788277af4310812da663966a7de6, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.481276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.568572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1162/2328] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:15 2022] PUT /identity/v3/projects/c991bc57e69a4fcfa0d213076e7ce2a0/users/4b13788277af4310812da663966a7de6/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:15.572708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.586082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596ddcf-38a1-4af6-9c58-e167fe0297a4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.647362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:15.656867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350fb4d-e19a-4644-adbb-0e458ec6973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.657573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350fb4d-e19a-4644-adbb-0e458ec6973d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.657853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350fb4d-e19a-4644-adbb-0e458ec6973d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.658261 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350fb4d-e19a-4644-adbb-0e458ec6973d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.659023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350fb4d-e19a-4644-adbb-0e458ec6973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.660620 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350fb4d-e19a-4644-adbb-0e458ec6973d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.671266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1167/2329] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:15.675985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.688042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6f884-3edb-454f-8247-81302ab7011a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.693411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.694325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.694757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.695209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] PATH_INFO: `/v3/projects/c991bc57e69a4fcfa0d213076e7ce2a0/users/4b13788277af4310812da663966a7de6/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.697856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c991bc57e69a4fcfa0d213076e7ce2a0, user_id=4b13788277af4310812da663966a7de6, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.700532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.715039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1163/2330] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:15 2022] PUT /identity/v3/projects/c991bc57e69a4fcfa0d213076e7ce2a0/users/4b13788277af4310812da663966a7de6/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:15.726446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.726761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.727011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.759270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] MFA Rules not processed for user `4b13788277af4310812da663966a7de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:15.760934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:15.844974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1168/2331] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:15.851217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:15.852985 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:15.894865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:15.912138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a63c5-b6dc-4e8e-8f2e-327ad4364a5a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:15.915912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:15.916529 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:15.916850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:15.917130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:15.975780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:15.976074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:15.985514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1164/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:17.960417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:17.961855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:17.974159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e71c4-7f62-4e46-bdf8-33411e82fa75 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:17.977951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66035671-50b0-4e31-8638-89a4047984c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:17.978550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66035671-50b0-4e31-8638-89a4047984c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:17.978829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66035671-50b0-4e31-8638-89a4047984c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:17.979104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66035671-50b0-4e31-8638-89a4047984c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:18.034843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66035671-50b0-4e31-8638-89a4047984c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:18.036195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66035671-50b0-4e31-8638-89a4047984c9 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:18.044957 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1169/2333] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:19.394065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:19.412226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aab48-28bb-4a28-8a0a-b34c874fdd7c service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:19.412226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:19.412226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:19.412226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:19.412650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:19.425500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:19.426932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:19.441162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1165/2334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:21.374588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:21.374588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:21.374588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:21.410431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:21.413065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:21.484357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1170/2335] 10.222.0.60 () {58 vars in 967 bytes} [Wed Jul 27 08:45:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:21.502519 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:21.506432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:21.611358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788acee1-89b9-411f-af4d-f79407415aad service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:21.617463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:21.621862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:21.621862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:21.621862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:21.627920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:21.629561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:21.638099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1166/2336] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:21.942300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:21.944566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:21.971323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:22.021147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790753-ccae-4d9f-a710-d0da9b32ea83 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:22.026301 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:22.026952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:22.027237 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:22.027513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:22.029401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:22.044776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:22.044776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bde865-9b7f-4b62-8712-9ceb14b76825 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:22.057430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1171/2337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:24.260868 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:24.327237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09b76a-df48-4adf-9e6a-01f7ae56c8ee service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:24.332014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:24.332677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:24.332990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:24.333279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] PATH_INFO: `/v3/users/d5a072cb48104047bd3d7d633af00d49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:24.334469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a072cb48104047bd3d7d633af00d49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:24.336441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:24.342720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:24.589861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a072cb48104047bd3d7d633af00d49'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:24.590696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a072cb48104047bd3d7d633af00d49'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:24.614513 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a072cb48104047bd3d7d633af00d49'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:24.635679 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a072cb48104047bd3d7d633af00d49'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:24.636675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a072cb48104047bd3d7d633af00d49'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:24.732039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1167/2338] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:24 2022] DELETE /identity/v3/users/d5a072cb48104047bd3d7d633af00d49 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:24.734694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e1c6-d1b5-4ece-abf5-c22a0b17470e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:24.735184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e1c6-d1b5-4ece-abf5-c22a0b17470e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:24.735491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e1c6-d1b5-4ece-abf5-c22a0b17470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:24.781367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-b4b2e1c6-d1b5-4ece-abf5-c22a0b17470e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:24.782834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b4b2e1c6-d1b5-4ece-abf5-c22a0b17470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:24.850214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1172/2339] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:24.865463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:24.866906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:24.917945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:24.918400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:24.918859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:24.957244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:24.958683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:24.967572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a8d44-1807-4149-a348-f918c834104c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:24.972892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:24.973522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:24.974306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:24.974427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:24.985172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:24.987093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:24.998108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1168/2340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:25.028899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1173/2341] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:45:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:25.040369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:25.041777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:25.125445 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5eef-ffea-40c2-a213-3d08826ee72d service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:25.130943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:25.135398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:25.135398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:25.135398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:25.144045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:25.145771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:25.155956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1169/2342] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:25.731914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:25.733554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:25.761448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f79f-7a2b-4428-b953-7344533e5e68 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:25.768977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:25.770126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:25.770725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:25.772596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] PATH_INFO: `/v3/projects/3b036853057d4baa9f4c5257ec5981e7` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:25.774285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b036853057d4baa9f4c5257ec5981e7)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:25.786556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:25.905339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:25.908541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b036853057d4baa9f4c5257ec5981e7', 'request_id': 'req-266105fc-0b92-4165-b567-221edeb2e8e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:25.915769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b036853057d4baa9f4c5257ec5981e7', 'request_id': 'req-266105fc-0b92-4165-b567-221edeb2e8e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:25.933678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b036853057d4baa9f4c5257ec5981e7', 'request_id': 'req-266105fc-0b92-4165-b567-221edeb2e8e4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.010473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] The token cache is being invalidate because project 3b036853057d4baa9f4c5257ec5981e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:26.010473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.010473 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.014955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1174/2343] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:25 2022] DELETE /identity/v3/projects/3b036853057d4baa9f4c5257ec5981e7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:26.020805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:26.047872 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b022-59f3-41a4-a125-879d64577d4a service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:26.077018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:26.112456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:26.114043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:26.158935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:26.160380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:26.160909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:26.161407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] PATH_INFO: `/v3/users/b4e66e089fcd4934ac1b67255a6e120c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:26.163511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e66e089fcd4934ac1b67255a6e120c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:26.165707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:26.245417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266105fc-0b92-4165-b567-221edeb2e8e4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:26.250270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:26.251033 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:26.251492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:26.251872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:26.253831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:26.271754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:26.273505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:26.290474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1175/2344] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:26.357976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e66e089fcd4934ac1b67255a6e120c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.359771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e66e089fcd4934ac1b67255a6e120c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.383641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e66e089fcd4934ac1b67255a6e120c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.415836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e66e089fcd4934ac1b67255a6e120c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.418503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e66e089fcd4934ac1b67255a6e120c'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:26.521739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1170/2345] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:26 2022] DELETE /identity/v3/users/b4e66e089fcd4934ac1b67255a6e120c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:28.025911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:28.030598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:28.051436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c33a5a-f2cc-4a26-9dd6-cac9a6ad0b9a service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:28.127650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:28.128461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:28.129196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:28.129734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] PATH_INFO: `/v3/projects/b8f34c16c4b04ad89b08c645c3eaccee` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:28.131104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f34c16c4b04ad89b08c645c3eaccee)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:28.134080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:28.267702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f34c16c4b04ad89b08c645c3eaccee', 'request_id': 'req-31751853-f1a6-452f-9e08-c8bbfff2b012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.273432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f34c16c4b04ad89b08c645c3eaccee', 'request_id': 'req-31751853-f1a6-452f-9e08-c8bbfff2b012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.281472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f34c16c4b04ad89b08c645c3eaccee', 'request_id': 'req-31751853-f1a6-452f-9e08-c8bbfff2b012'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.404585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] The token cache is being invalidate because project b8f34c16c4b04ad89b08c645c3eaccee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:28.405765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.406817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.409720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1176/2346] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:28 2022] DELETE /identity/v3/projects/b8f34c16c4b04ad89b08c645c3eaccee => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:28.414424 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:28.426869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:28.448787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5823349-425a-4fd9-84d6-dfc605d3257a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:28.565846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:28.566537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:28.566817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:28.567092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] PATH_INFO: `/v3/users/4b13788277af4310812da663966a7de6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:28.568294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b13788277af4310812da663966a7de6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:28.570272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:28.772289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:28.790149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b13788277af4310812da663966a7de6'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.790986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b13788277af4310812da663966a7de6'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.811327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b13788277af4310812da663966a7de6'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.883188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b13788277af4310812da663966a7de6'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.884040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-7ae3031d-e3c4-4143-8647-15dc6a58da12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b13788277af4310812da663966a7de6'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:28.979818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1171/2347] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:28 2022] DELETE /identity/v3/users/4b13788277af4310812da663966a7de6 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:30.392025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:30.394602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:30.402696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:30.520348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31751853-f1a6-452f-9e08-c8bbfff2b012 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:30.648662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:30.649359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:30.649666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:30.649949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] PATH_INFO: `/v3/projects/c991bc57e69a4fcfa0d213076e7ce2a0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:30.651493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c991bc57e69a4fcfa0d213076e7ce2a0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:30.653496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:30.916823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c991bc57e69a4fcfa0d213076e7ce2a0', 'request_id': 'req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:30.947630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c991bc57e69a4fcfa0d213076e7ce2a0', 'request_id': 'req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:30.961792 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c991bc57e69a4fcfa0d213076e7ce2a0', 'request_id': 'req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:31.067801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] The token cache is being invalidate because project c991bc57e69a4fcfa0d213076e7ce2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:31.068887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:31.076322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d7efc7ec-c6c7-44ca-90bc-8692ebe0e6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:31.078532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1177/2348] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:30 2022] DELETE /identity/v3/projects/c991bc57e69a4fcfa0d213076e7ce2a0 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:31.080189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:31.080648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:31.080773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:31.225984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:31.228030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:31.327095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1172/2349] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:31.330537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:31.331023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:31.331415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:31.356646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:31.358589 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:31.373949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:31.383902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1178/2350] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:31.386745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67b8f-dece-4012-9243-d503930e3822 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:31.394308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:31.395107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:31.395527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:31.395878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:31.396668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:31.397098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:31.398901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:31.426582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:31.437699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1173/2351] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:31.439043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2896e-7c2b-4e7a-85b9-b88835620ae4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:31.457055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:31.459539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:31.460250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:31.460702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:31.461580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:31.463719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:31.579675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:31.590168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1179/2352] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:31 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:31.595461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:31.611972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a122e71-ede8-4c4a-a9e6-bf74ccdb4ecc admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:31.792378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:31.794428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:31.796071 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:31.796653 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:31.797555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:31.799811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:31.908159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:31.912776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1174/2353] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:31 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:31.932225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbf35f-188f-4b81-98e9-92999a72d94c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:31.945192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:31.950965 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:31.951942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:31.952288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:31.955549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:31.959640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:31.983547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1180/2354] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:31.986510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:31.992828 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:32.002402 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa63d-7386-4333-b5a2-7b1440de673e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:32.010259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b4466-c468-49d3-8d8a-ada95c7f9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:32.014824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4466-c468-49d3-8d8a-ada95c7f9482 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:32.014824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4466-c468-49d3-8d8a-ada95c7f9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:32.014824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4466-c468-49d3-8d8a-ada95c7f9482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:32.014824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b4466-c468-49d3-8d8a-ada95c7f9482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:32.016983 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b4466-c468-49d3-8d8a-ada95c7f9482 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:32.045674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1175/2355] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:32.046442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:32.068107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687b71d-59bf-4cd2-9484-c35764b4f8bb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:32.083231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:32.084269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:32.084560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:32.085001 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] PATH_INFO: `/v3/projects/93054ff80433414b920a5960155c5c89/users/409c98bccf6742009eb1d60a9d78b162/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:32.126755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=93054ff80433414b920a5960155c5c89, user_id=409c98bccf6742009eb1d60a9d78b162, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:32.131450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:32.266367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1181/2356] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:32 2022] PUT /identity/v3/projects/93054ff80433414b920a5960155c5c89/users/409c98bccf6742009eb1d60a9d78b162/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:32.285737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:32.286293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:32.286293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:32.370109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] MFA Rules not processed for user `409c98bccf6742009eb1d60a9d78b162`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:32.371398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:32.572575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1176/2357] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:32.573744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:32.723258 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0d8c-11a7-4141-bd0c-53c68306bbec admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:32.758143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:32.770199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:32.770199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:32.770199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:32.770199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:32.770199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:32.968037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1182/2358] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:32 2022] POST /identity/v3/projects => generated 383 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:32.972048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:33.033219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a62ee-c0b4-4a76-a9e5-0a7663f8972c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:33.128896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:33.129901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.130403 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.130884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.131774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:33.134288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:33.212776 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:33.217853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:33.233192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1177/2359] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:32 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:33.242532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:33.257706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073594b-5c0c-47e0-a5aa-4d8213c871d2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:33.265207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801a837-465e-49ca-becb-f605832644d2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:33.274960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:33.279768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.279768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.279768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.279768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:33.279768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:33.281105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:33.282414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.284269 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.284813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] PATH_INFO: `/v3/users/4d4013ba9eca412b81585544a52e38ea` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.287494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4013ba9eca412b81585544a52e38ea)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:33.290260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:33.320750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1178/2360] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:33.324165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:33.344944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1509b58-806f-4531-be99-7d2d689c5385 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:33.351451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:33.352155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.352457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.352753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.353456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:33.355186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:33.387095 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1179/2361] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:33.392434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:33.412604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf26d2-a7f4-436c-98b8-d8e66e19e967 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:33.420340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b5ff6-7b86-41d8-a7a7-90604c56e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:33.421369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b5ff6-7b86-41d8-a7a7-90604c56e529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.423851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b5ff6-7b86-41d8-a7a7-90604c56e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.423851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b5ff6-7b86-41d8-a7a7-90604c56e529 admin admin] PATH_INFO: `/v3/projects/9069dee2d7904518ac196351e53f2026/users/bb268805003944999eb1fa7d88346830/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.442891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b5ff6-7b86-41d8-a7a7-90604c56e529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9069dee2d7904518ac196351e53f2026, user_id=bb268805003944999eb1fa7d88346830, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:33.448379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b5ff6-7b86-41d8-a7a7-90604c56e529 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:33.485381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4013ba9eca412b81585544a52e38ea'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:33.537460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1180/2362] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:33 2022] PUT /identity/v3/projects/9069dee2d7904518ac196351e53f2026/users/bb268805003944999eb1fa7d88346830/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:33.586870 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4013ba9eca412b81585544a52e38ea'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:33.608051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.608051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.608374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.610193 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4013ba9eca412b81585544a52e38ea'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:33.612148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4013ba9eca412b81585544a52e38ea'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:33.613268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4013ba9eca412b81585544a52e38ea'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:33.644254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] MFA Rules not processed for user `bb268805003944999eb1fa7d88346830`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:33.645527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:33.647411 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1183/2363] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:33 2022] DELETE /identity/v3/users/4d4013ba9eca412b81585544a52e38ea => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:33.661425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:33.774922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1181/2364] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:33.779623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:33.782850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:33.822072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:33.908051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2d1f1-b9ce-4cbc-9ad0-640c02dee2fe admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:33.914063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:33.914706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:33.915060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:33.915351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:33.916079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:33.918603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.036344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1184/2365] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:33 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:34.039897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.083068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.089043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:34.095203 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f7ee-4dbd-4977-8d86-b8b920a2ca02 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.253463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.254132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.254417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.254709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.255395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.257360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.271219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53795fb4-acd6-4385-aab2-d1bc5685b901 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.280868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.282663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.282663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.282663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] PATH_INFO: `/v3/projects/6add677907ea469a8379675104571fd3` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.283300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6add677907ea469a8379675104571fd3)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.285341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.360046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1182/2366] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:34 2022] POST /identity/v3/users => generated 298 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:34.360046 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.376065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b1e8-a986-456f-a12e-f069eff14f70 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.401430 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6add677907ea469a8379675104571fd3', 'request_id': 'req-44351f65-cab1-4d8d-9680-037d79a5b33e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:34.410401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6add677907ea469a8379675104571fd3', 'request_id': 'req-44351f65-cab1-4d8d-9680-037d79a5b33e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:34.417427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6add677907ea469a8379675104571fd3', 'request_id': 'req-44351f65-cab1-4d8d-9680-037d79a5b33e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:34.512710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.513378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.515740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.516209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.517014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.522929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.531880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] The token cache is being invalidate because project 6add677907ea469a8379675104571fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:34.532575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:34.533862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-44351f65-cab1-4d8d-9680-037d79a5b33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:34.537176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1185/2367] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:34 2022] DELETE /identity/v3/projects/6add677907ea469a8379675104571fd3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:34.538505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1183/2368] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:34.542780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.543835 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f6d48-cc66-438c-9e5d-94582fce4e2c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.544279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f6d48-cc66-438c-9e5d-94582fce4e2c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.544768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f6d48-cc66-438c-9e5d-94582fce4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.546073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:34.581278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067f256-af65-445a-870f-5d4df7feb26a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.583344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-604f6d48-cc66-438c-9e5d-94582fce4e2c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:34.584604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-604f6d48-cc66-438c-9e5d-94582fce4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:34.592694 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.595557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.596372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.596918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] PATH_INFO: `/v3/projects/a426b8e149dc4fbf83a239f30f2e3df5/users/bd154ef2f65d4d07b0cf650707851975/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.627791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1186/2369] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:34.631132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.631132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.631132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.637216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a426b8e149dc4fbf83a239f30f2e3df5, user_id=bd154ef2f65d4d07b0cf650707851975, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.650431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.667908 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:34.669171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:34.718678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1187/2370] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:34.724164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.726603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1184/2371] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:34 2022] PUT /identity/v3/projects/a426b8e149dc4fbf83a239f30f2e3df5/users/bd154ef2f65d4d07b0cf650707851975/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:34.732008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.743950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8ffef-6309-4776-964b-8e9b301ef6b4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.783829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:34.819858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:34.893897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.894531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.895972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.895972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.895972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:34.896229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.898694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.927700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1188/2372] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:34.931810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:34.953979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd0735-0a30-476d-bca0-4c934e244063 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.967426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427db92-26c9-4d28-976c-a3fefd2706f7 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:34.979089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.979681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.979966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.980239 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.984684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.986702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:34.989971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:34.990619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:34.990900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:34.991173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:34.991875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:34.994351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.020779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1185/2373] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:35.025286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:35.043419 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69e04c-e2b2-45b7-965e-710ac2107093 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:35.054677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d445a6-40b3-41c9-bb9d-d6f55bbb4076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:35.055377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d445a6-40b3-41c9-bb9d-d6f55bbb4076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.058516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d445a6-40b3-41c9-bb9d-d6f55bbb4076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.058516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d445a6-40b3-41c9-bb9d-d6f55bbb4076 admin admin] PATH_INFO: `/v3/projects/a426b8e149dc4fbf83a239f30f2e3df5/users/bd154ef2f65d4d07b0cf650707851975/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.061880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d445a6-40b3-41c9-bb9d-d6f55bbb4076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a426b8e149dc4fbf83a239f30f2e3df5, user_id=bd154ef2f65d4d07b0cf650707851975, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:35.064586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d445a6-40b3-41c9-bb9d-d6f55bbb4076 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.095441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1186/2374] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:35 2022] PUT /identity/v3/projects/a426b8e149dc4fbf83a239f30f2e3df5/users/bd154ef2f65d4d07b0cf650707851975/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:35.107364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.108022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.108312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.118249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1189/2375] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:34 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:35.123522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:35.177820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] MFA Rules not processed for user `bd154ef2f65d4d07b0cf650707851975`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:35.183153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:35.296221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c94ac-db92-4210-8c51-41985444bce3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:35.307386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:35.308036 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.308311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.308583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.313363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:35.323671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.411026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1187/2376] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:35.423629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:35.425323 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:35.452826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1190/2377] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:35 2022] POST /identity/v3/users => generated 287 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:35.454377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:35.469375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34038-f1c4-4ed0-88c8-00fb24fab69b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:35.476880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:35.477680 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.478066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.478503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.479333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:35.481768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.506099 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1191/2378] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:35.506666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:35.525040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934895d-ce43-4fde-add1-d79868608687 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:35.531926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:35.532554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.532891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.533168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.533924 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:35.536245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.560058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1192/2379] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:35.562524 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:35.586087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee46ac-0917-40a8-8d1a-8be85f369a89 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:35.593417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:35.594515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.594515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.594750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] PATH_INFO: `/v3/projects/ab321b2c05734161b0b76c9ff0e0b010/users/e708bf7f6edc4fc695a83ac411aad0b8/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.611567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab321b2c05734161b0b76c9ff0e0b010, user_id=e708bf7f6edc4fc695a83ac411aad0b8, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:35.614716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.692086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:35.694585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5c09c-9580-4132-9565-ec55c12cb221 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:35.712180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:35.712180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:35.712180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:35.712180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:35.713629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:35.778328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:35.779938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a621-dcca-4e7d-8cb2-17753b76d913 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:35.789826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1188/2380] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:36.066361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1193/2381] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:35 2022] PUT /identity/v3/projects/ab321b2c05734161b0b76c9ff0e0b010/users/e708bf7f6edc4fc695a83ac411aad0b8/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:36.076661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.077073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.077356 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.105122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] MFA Rules not processed for user `e708bf7f6edc4fc695a83ac411aad0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:36.106333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:36.138581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.142095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:36.179793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1189/2382] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:36.184306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.189079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:36.211417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41657ffb-9e76-4c31-bc6a-a748961535db admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.216111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.218015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.218015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.218015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] PATH_INFO: `/v3/users/aada52c9ee894a848cd7588d06c3017f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.219144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aada52c9ee894a848cd7588d06c3017f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.221128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.248155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db55a1-dc31-4c5d-ab03-343fa1b24885 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.252900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.253515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.253795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.254073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.254732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.256624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.334395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1190/2383] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:36 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:36.338383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.360795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:36.364238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aada52c9ee894a848cd7588d06c3017f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:36.402609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb610ee-0992-4982-9947-1bcb32821924 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.407837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.408444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.408754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.409036 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.409885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.411786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.440672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aada52c9ee894a848cd7588d06c3017f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:36.448302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aada52c9ee894a848cd7588d06c3017f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:36.448975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aada52c9ee894a848cd7588d06c3017f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:36.449674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aada52c9ee894a848cd7588d06c3017f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:36.468048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1194/2384] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:36 2022] DELETE /identity/v3/users/aada52c9ee894a848cd7588d06c3017f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:36.517317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1191/2385] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:36 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:36.520990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.524647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:36.598443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323373d3-26b7-41c4-9c26-6e27ad6a6b66 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.604350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.605472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.605472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.605807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.606384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.608174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.620763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1195/2386] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:36.622937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.636091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6162c85-9755-4af4-b42c-6a40a3552ed4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.642633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.643313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.643599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.643877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] PATH_INFO: `/v3/projects/4497e45990be4ab68239a740e9f318a2/users/94f797c4e143498a923764f1a2a14884/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.660475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4497e45990be4ab68239a740e9f318a2, user_id=94f797c4e143498a923764f1a2a14884, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.663058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.797257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1192/2387] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:36 2022] PUT /identity/v3/projects/4497e45990be4ab68239a740e9f318a2/users/94f797c4e143498a923764f1a2a14884/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:36.801529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.805867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.808563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:36.813487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a9173-9bea-48c3-b1ae-6ffd3d6fbaab admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.891052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:36.901551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.907636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.907636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.907636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.907636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.907636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.914955 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44067f2-3e83-4d56-879f-6d4db25dc212 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.917043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1196/2388] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:36.919796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.921452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.921725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.921962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] PATH_INFO: `/v3/projects/76b34f05485142d2876a7d9e6e7e3126` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.922095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:36.923335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b34f05485142d2876a7d9e6e7e3126)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.925377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.932427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12652eaa-07f4-49bd-b9fb-5fb40fb30876 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:36.939515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306e91-4160-42d0-96b2-5ac3d91a57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:36.940312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306e91-4160-42d0-96b2-5ac3d91a57a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.941585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306e91-4160-42d0-96b2-5ac3d91a57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.941585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306e91-4160-42d0-96b2-5ac3d91a57a0 admin admin] PATH_INFO: `/v3/projects/4497e45990be4ab68239a740e9f318a2/users/94f797c4e143498a923764f1a2a14884/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:36.943279 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306e91-4160-42d0-96b2-5ac3d91a57a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4497e45990be4ab68239a740e9f318a2, user_id=94f797c4e143498a923764f1a2a14884, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:36.946273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306e91-4160-42d0-96b2-5ac3d91a57a0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:36.957812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1197/2389] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:36 2022] PUT /identity/v3/projects/4497e45990be4ab68239a740e9f318a2/users/94f797c4e143498a923764f1a2a14884/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:36.972087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:36.972087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:36.972087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:37.002442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] MFA Rules not processed for user `94f797c4e143498a923764f1a2a14884`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:37.003789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:37.047286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b34f05485142d2876a7d9e6e7e3126', 'request_id': 'req-d6e39b39-821f-42df-9ad0-0891e335a046'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.053929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b34f05485142d2876a7d9e6e7e3126', 'request_id': 'req-d6e39b39-821f-42df-9ad0-0891e335a046'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.060449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b34f05485142d2876a7d9e6e7e3126', 'request_id': 'req-d6e39b39-821f-42df-9ad0-0891e335a046'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.078025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1198/2390] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:37.090045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:37.091481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:37.127591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] The token cache is being invalidate because project 76b34f05485142d2876a7d9e6e7e3126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:37.128049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.128864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.130623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1193/2391] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:36 2022] DELETE /identity/v3/projects/76b34f05485142d2876a7d9e6e7e3126 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:37.134590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:37.136911 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:37.153865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3a06-8d6d-4162-8abb-96180ba1e6da None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:37.155048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:37.204137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:37.204781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:37.205060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:37.205330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:37.207077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e39b39-821f-42df-9ad0-0891e335a046 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:37.207205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:37.212132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:37.212798 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:37.213159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:37.213463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] PATH_INFO: `/v3/users/a591babdffe04db4b60b98fc9f7b0c94` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:37.214814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a591babdffe04db4b60b98fc9f7b0c94)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:37.217072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:37.269322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:37.270686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:37.281022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1199/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:37.438686 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a591babdffe04db4b60b98fc9f7b0c94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.439404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a591babdffe04db4b60b98fc9f7b0c94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.446567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a591babdffe04db4b60b98fc9f7b0c94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.460870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a591babdffe04db4b60b98fc9f7b0c94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.461587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a591babdffe04db4b60b98fc9f7b0c94'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:37.562671 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1194/2393] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:37 2022] DELETE /identity/v3/users/a591babdffe04db4b60b98fc9f7b0c94 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:37.578976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:37.821382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:37.833111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f0222-54b7-4be8-9647-2c65dc6ccde5 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:37.912932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:37.913598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:37.913877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:37.914153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] PATH_INFO: `/v3/projects/d8bd07ebebf24782aa153b7b41465862` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:37.915455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8bd07ebebf24782aa153b7b41465862)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:37.917416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:37.926360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:37.927830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:37.987517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6400fa-5789-4b63-86d1-c6b37027e795 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:37.991927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:37.992550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:37.992864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:37.993141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:37.995109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:38.044314 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8bd07ebebf24782aa153b7b41465862', 'request_id': 'req-aa538177-d4b0-4430-84cc-40a819777c15'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.044939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:38.051451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8bd07ebebf24782aa153b7b41465862', 'request_id': 'req-aa538177-d4b0-4430-84cc-40a819777c15'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.057413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8bd07ebebf24782aa153b7b41465862', 'request_id': 'req-aa538177-d4b0-4430-84cc-40a819777c15'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.058972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:38.060567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:38.071819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1195/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:38.134532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] The token cache is being invalidate because project d8bd07ebebf24782aa153b7b41465862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:38.135133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.135590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-aa538177-d4b0-4430-84cc-40a819777c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.137275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1200/2395] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:37 2022] DELETE /identity/v3/projects/d8bd07ebebf24782aa153b7b41465862 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:38.239019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:38.241845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:38.264874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666a63b-d4b9-4b26-ba89-8d008a92b76f service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:38.436845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:38.437712 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:38.438096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:38.438471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] PATH_INFO: `/v3/users/e708bf7f6edc4fc695a83ac411aad0b8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:38.440231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e708bf7f6edc4fc695a83ac411aad0b8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:38.445184 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:38.678498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e708bf7f6edc4fc695a83ac411aad0b8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.679539 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e708bf7f6edc4fc695a83ac411aad0b8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.688386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e708bf7f6edc4fc695a83ac411aad0b8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.700421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e708bf7f6edc4fc695a83ac411aad0b8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.701169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e708bf7f6edc4fc695a83ac411aad0b8'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:38.804907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1196/2396] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:38 2022] DELETE /identity/v3/users/e708bf7f6edc4fc695a83ac411aad0b8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:38.810746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7a493-f633-482c-a019-650668b2073a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:38.811043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7a493-f633-482c-a019-650668b2073a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:38.811325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7a493-f633-482c-a019-650668b2073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:38.832412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2bc7a493-f633-482c-a019-650668b2073a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:38.833700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2bc7a493-f633-482c-a019-650668b2073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:38.886479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:38.905455 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1201/2397] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:38.915661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:38.917127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:39.004150 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:39.008663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc367-bc4a-4cee-94ea-de7c3634b822 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:39.017058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:39.017058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:39.017058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:39.017058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:39.025792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:39.027319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:39.037256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1197/2398] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:39.443769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7a493-f633-482c-a019-650668b2073a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:39.445345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2bc7a493-f633-482c-a019-650668b2073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:39.462408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7a493-f633-482c-a019-650668b2073a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:39.474834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:39.474834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:39.475698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:39.475698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] PATH_INFO: `/v3/projects/ab321b2c05734161b0b76c9ff0e0b010` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:39.476715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab321b2c05734161b0b76c9ff0e0b010)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:39.478817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:39.611989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:39.614080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:39.630408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab321b2c05734161b0b76c9ff0e0b010', 'request_id': 'req-56098801-1b17-4213-8eb6-ee7db9a07320'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:39.637341 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab321b2c05734161b0b76c9ff0e0b010', 'request_id': 'req-56098801-1b17-4213-8eb6-ee7db9a07320'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:39.644856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab321b2c05734161b0b76c9ff0e0b010', 'request_id': 'req-56098801-1b17-4213-8eb6-ee7db9a07320'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:39.679020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbb9c6-3c39-498a-b8f2-4b70d07e9423 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:39.710385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] The token cache is being invalidate because project ab321b2c05734161b0b76c9ff0e0b010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:39.710598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:39.711256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:39.712847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1202/2399] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:39 2022] DELETE /identity/v3/projects/ab321b2c05734161b0b76c9ff0e0b010 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:39.717868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:39.719369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:39.729950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:39.730554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:39.730841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:39.731113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:39.733124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:39.785705 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098801-1b17-4213-8eb6-ee7db9a07320 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:39.790594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:39.791238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:39.791571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:39.791851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] PATH_INFO: `/v3/users/94f797c4e143498a923764f1a2a14884` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:39.793035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f797c4e143498a923764f1a2a14884)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:39.795019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:39.799825 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:39.801478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:39.811526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1198/2400] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:39.970287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f797c4e143498a923764f1a2a14884'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.024694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f797c4e143498a923764f1a2a14884'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.033435 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f797c4e143498a923764f1a2a14884'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.040288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f797c4e143498a923764f1a2a14884'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.044505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f797c4e143498a923764f1a2a14884'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.056012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:40.060353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1203/2401] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:39 2022] DELETE /identity/v3/users/94f797c4e143498a923764f1a2a14884 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:40.285909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:40.288146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:40.352812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:40.374764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a735b-576f-488c-8683-f79b81fed4a2 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:40.445081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:40.445786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:40.449027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:40.451617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:40.453901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:40.466253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:40.467857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1017492-f3ff-40e5-88cf-0073d5d056da service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:40.478596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1199/2402] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:40.542168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:40.544602 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:40.619039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2227c-51b8-4745-8bbf-920eb2d50123 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:40.623918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:40.624558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:40.624874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:40.625153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] PATH_INFO: `/v3/projects/4497e45990be4ab68239a740e9f318a2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:40.626309 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4497e45990be4ab68239a740e9f318a2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:40.628465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:40.744930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4497e45990be4ab68239a740e9f318a2', 'request_id': 'req-c623ed73-99a2-4c0f-9656-3ebd012405f6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.754932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4497e45990be4ab68239a740e9f318a2', 'request_id': 'req-c623ed73-99a2-4c0f-9656-3ebd012405f6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.761199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4497e45990be4ab68239a740e9f318a2', 'request_id': 'req-c623ed73-99a2-4c0f-9656-3ebd012405f6'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.855819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] The token cache is being invalidate because project 4497e45990be4ab68239a740e9f318a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:40.856134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.864038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c623ed73-99a2-4c0f-9656-3ebd012405f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:40.865791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1204/2403] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:40 2022] DELETE /identity/v3/projects/4497e45990be4ab68239a740e9f318a2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:40.870666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:40.871060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:40.871151 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:40.893033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:40.894545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:40.957017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1200/2404] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:40.964879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:40.965166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:40.965441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:40.984999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:40.986184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:40.994137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1205/2405] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:40.999874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:41.009506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34ae8-f484-468f-a94a-4e9604362fb7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:41.014897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:41.015546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:41.015826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:41.016102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:41.016819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:41.017128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:41.018714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:41.031280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1201/2406] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:41.036287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:41.047648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabed90-d0d8-4f2e-9555-7e21e42120fe None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:41.052378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71c1b7-8413-49ad-ba14-da409b602b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:41.053024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71c1b7-8413-49ad-ba14-da409b602b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:41.053308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71c1b7-8413-49ad-ba14-da409b602b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:41.053581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71c1b7-8413-49ad-ba14-da409b602b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:41.054245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71c1b7-8413-49ad-ba14-da409b602b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:41.056159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71c1b7-8413-49ad-ba14-da409b602b13 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:41.998224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1206/2407] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:41 2022] POST /identity/v3/projects => generated 369 bytes in 963 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:42.002548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.012709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa668b-6254-4ca8-a145-f4ecd9fc5756 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.086287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.086603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.086845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.103474 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.104444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.105814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.105814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.105814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.108374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.121084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:42.122085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:42.123461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:42.173682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:42.188119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1202/2408] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:42 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:42.191682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1207/2409] 10.222.0.60 () {58 vars in 967 bytes} [Wed Jul 27 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:42.192196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.203703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3d450-eb4d-4e6e-86f0-37cc041a9560 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.209490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.210214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.210408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.210690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.211395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.213040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.213385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.215443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:42.228308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1203/2410] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:42.232714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.245423 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c171-7c29-455d-90ee-ec5366ab4ec9 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.252397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.253085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.253369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.253645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.254342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.255933 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.271431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1204/2411] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:42.272796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.293358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aa6ca-e629-40d9-90e9-29aedd34ee2e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.300278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.301210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.301664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.302005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] PATH_INFO: `/v3/projects/de18ed4b287144a0be001a65b293c016/users/80a3fc5e40984e518273e20ce6f58e39/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.312945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437864-efd7-4553-a1d4-c0d672aa8f0e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.319086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7b167-bc7f-444b-b342-5f512cf364a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.319786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b167-bc7f-444b-b342-5f512cf364a1 service swift] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.320958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b167-bc7f-444b-b342-5f512cf364a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.321271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b167-bc7f-444b-b342-5f512cf364a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.321624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de18ed4b287144a0be001a65b293c016, user_id=80a3fc5e40984e518273e20ce6f58e39, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.324581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.331961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b167-bc7f-444b-b342-5f512cf364a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.333604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b167-bc7f-444b-b342-5f512cf364a1 service swift] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.348040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1208/2412] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:45:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:42.412943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1205/2413] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:42 2022] PUT /identity/v3/projects/de18ed4b287144a0be001a65b293c016/users/80a3fc5e40984e518273e20ce6f58e39/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:42.425690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.426133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.426687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.460307 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] MFA Rules not processed for user `80a3fc5e40984e518273e20ce6f58e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:42.461935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:42.549550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1209/2414] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:42.555461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.624064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad58ad-68e5-41f4-956f-7aa092590203 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.632593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.632593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.632593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.632593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.633274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.633598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.766948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1206/2415] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:42 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:42.768050 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.787376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00af37-6122-45c3-a25a-21e8dfb92e4b None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.840641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.841313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.841606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.842783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.843919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.846484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.933349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1210/2416] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:42 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:42.938021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.948996 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce3e31-5646-49f2-b8f9-c353650ddf3e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.954567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.955192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.955512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.955795 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.958241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:42.958241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:42.969904 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1207/2417] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:42.974187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:42.984429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0456d-d144-450d-b4d1-7bdd01bebb0e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:42.989012 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:42.989665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:42.989942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:42.990214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] PATH_INFO: `/v3/projects/0cbfbacc31cb41428acbd3b3c5702265/users/da197496bdf34716b5313dcc3eb6839a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:42.992381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:43.005510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbfbacc31cb41428acbd3b3c5702265, user_id=da197496bdf34716b5313dcc3eb6839a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:43.008179 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:43.119359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1211/2418] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:42 2022] PUT /identity/v3/projects/0cbfbacc31cb41428acbd3b3c5702265/users/da197496bdf34716b5313dcc3eb6839a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:43.124101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:43.135296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc0bb9-b97c-4bdc-a0fe-bb1367a7524c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:43.206699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de787c-eec7-4b41-97b5-34a0fea2ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:43.207634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de787c-eec7-4b41-97b5-34a0fea2ab2a admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:43.208077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de787c-eec7-4b41-97b5-34a0fea2ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:43.208509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de787c-eec7-4b41-97b5-34a0fea2ab2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:43.209522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de787c-eec7-4b41-97b5-34a0fea2ab2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:43.212130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de787c-eec7-4b41-97b5-34a0fea2ab2a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:43.227927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1208/2419] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:43.229546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:43.241137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0182f-3b06-4140-b089-4e9a6f446ec1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:43.246364 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:43.247208 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:43.247772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:43.248686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] PATH_INFO: `/v3/projects/0cbfbacc31cb41428acbd3b3c5702265/users/da197496bdf34716b5313dcc3eb6839a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:43.251511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbfbacc31cb41428acbd3b3c5702265, user_id=da197496bdf34716b5313dcc3eb6839a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:43.268313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:43.268460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1212/2420] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:43 2022] PUT /identity/v3/projects/0cbfbacc31cb41428acbd3b3c5702265/users/da197496bdf34716b5313dcc3eb6839a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:43.278557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:43.278844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:43.279124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:43.309254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] MFA Rules not processed for user `da197496bdf34716b5313dcc3eb6839a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:43.311241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:43.322920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:43.398355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1209/2421] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:43.429498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:43.431415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:43.491758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc6a70-f98b-49f6-a126-b4ef33c5a0c1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:43.495671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:43.496321 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:43.496659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:43.496969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:43.507477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:43.508958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:43.519403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1213/2422] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:43.605023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:43.615766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f025bf3-2776-493e-96b7-5869dd468bbc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:43.619384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd9119-0b12-4d21-b7c5-d274e6ba213d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:43.619998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9119-0b12-4d21-b7c5-d274e6ba213d service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:43.620349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9119-0b12-4d21-b7c5-d274e6ba213d service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:43.620630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9119-0b12-4d21-b7c5-d274e6ba213d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:43.704520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9119-0b12-4d21-b7c5-d274e6ba213d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:43.706252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9119-0b12-4d21-b7c5-d274e6ba213d service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:43.722628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1210/2423] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:45.238772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:45.240221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:45.306110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd4a9-01ee-4f10-8e59-e92e7e75acbf service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:45.312117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:45.312827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:45.313108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:45.313378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] PATH_INFO: `/v3/users/409c98bccf6742009eb1d60a9d78b162` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:45.314554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409c98bccf6742009eb1d60a9d78b162)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:45.316565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:45.488480 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409c98bccf6742009eb1d60a9d78b162'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:45.534569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409c98bccf6742009eb1d60a9d78b162'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:45.543811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409c98bccf6742009eb1d60a9d78b162'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:45.545926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409c98bccf6742009eb1d60a9d78b162'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:45.546058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409c98bccf6742009eb1d60a9d78b162'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:45.555038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:45.564951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1214/2424] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:45 2022] DELETE /identity/v3/users/409c98bccf6742009eb1d60a9d78b162 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:45.569491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:45.569995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:45.570114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:45.589903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:45.591101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:45.653172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1211/2425] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:45.665616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:45.668692 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:45.729471 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a160f-61cc-404e-8a4b-85805bdb08e0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:45.733245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:45.733876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:45.734137 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:45.734409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:45.743393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:45.744863 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:45.755023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1215/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:46.180222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:46.185007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:46.195593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b2491-d7ef-49fc-976f-39bea3c9c7fc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:46.200471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:46.201177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:46.201463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:46.203895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] PATH_INFO: `/v3/projects/93054ff80433414b920a5960155c5c89` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:46.203895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93054ff80433414b920a5960155c5c89)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:46.205059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:46.332381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:46.339286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93054ff80433414b920a5960155c5c89', 'request_id': 'req-d7b9ac5c-ee16-4afb-b18e-6992bca39392'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.348006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93054ff80433414b920a5960155c5c89', 'request_id': 'req-d7b9ac5c-ee16-4afb-b18e-6992bca39392'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.354576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93054ff80433414b920a5960155c5c89', 'request_id': 'req-d7b9ac5c-ee16-4afb-b18e-6992bca39392'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.417311 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] The token cache is being invalidate because project 93054ff80433414b920a5960155c5c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:46.417875 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.418861 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.425241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1212/2427] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:46 2022] DELETE /identity/v3/projects/93054ff80433414b920a5960155c5c89 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:46.428228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:46.438948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2449462-1ed6-44eb-9620-db771b75b61d service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:46.523157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:46.523791 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:46.524072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:46.524343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] PATH_INFO: `/v3/users/bb268805003944999eb1fa7d88346830` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:46.525544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb268805003944999eb1fa7d88346830)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:46.527522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:46.746640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb268805003944999eb1fa7d88346830'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.812467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb268805003944999eb1fa7d88346830'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.819850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb268805003944999eb1fa7d88346830'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.820482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb268805003944999eb1fa7d88346830'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.821068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb268805003944999eb1fa7d88346830'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:46.842365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1216/2428] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:46 2022] DELETE /identity/v3/users/bb268805003944999eb1fa7d88346830 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:47.300223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:47.302473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:47.316910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ac5c-ee16-4afb-b18e-6992bca39392 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:47.384023 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:47.384595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:47.384956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:47.385247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] PATH_INFO: `/v3/projects/9069dee2d7904518ac196351e53f2026` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:47.386433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9069dee2d7904518ac196351e53f2026)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:47.388418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:47.522297 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9069dee2d7904518ac196351e53f2026', 'request_id': 'req-dbad6a67-87e1-42c6-b303-3b1029cd0478'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:47.527997 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9069dee2d7904518ac196351e53f2026', 'request_id': 'req-dbad6a67-87e1-42c6-b303-3b1029cd0478'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:47.534698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9069dee2d7904518ac196351e53f2026', 'request_id': 'req-dbad6a67-87e1-42c6-b303-3b1029cd0478'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:47.614055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] The token cache is being invalidate because project 9069dee2d7904518ac196351e53f2026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:47.614507 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:47.615306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:47.617051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1213/2429] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:47 2022] DELETE /identity/v3/projects/9069dee2d7904518ac196351e53f2026 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:47.624000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:47.625476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:47.639378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fac79-7011-4cdb-b237-ea9eff809dfe admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:47.648287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:47.707996 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:47.709008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:47.709362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:47.709712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] PATH_INFO: `/v3/users/bd154ef2f65d4d07b0cf650707851975` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:47.711215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd154ef2f65d4d07b0cf650707851975)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:47.713608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:48.014979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd154ef2f65d4d07b0cf650707851975'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:48.086979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd154ef2f65d4d07b0cf650707851975'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:48.095176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd154ef2f65d4d07b0cf650707851975'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:48.095840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd154ef2f65d4d07b0cf650707851975'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:48.096445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd154ef2f65d4d07b0cf650707851975'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:48.113844 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1217/2430] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:47 2022] DELETE /identity/v3/users/bd154ef2f65d4d07b0cf650707851975 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:48.781435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:48.782854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:48.796143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6a67-87e1-42c6-b303-3b1029cd0478 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:48.834593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:48.836238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:48.892086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:48.898940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:48.899593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:48.900052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:48.900332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] PATH_INFO: `/v3/users/80a3fc5e40984e518273e20ce6f58e39` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:48.901664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a3fc5e40984e518273e20ce6f58e39)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:48.903595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:48.941635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8a8dc-2d99-4c03-8c52-d608d5e2d47b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:48.946500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:48.947240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:48.947693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:48.947971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] PATH_INFO: `/v3/projects/a426b8e149dc4fbf83a239f30f2e3df5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:48.949211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a426b8e149dc4fbf83a239f30f2e3df5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:48.952350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.110272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:49.120753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a3fc5e40984e518273e20ce6f58e39'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.121793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a3fc5e40984e518273e20ce6f58e39'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.123814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a426b8e149dc4fbf83a239f30f2e3df5', 'request_id': 'req-13010f17-c2e5-4b7c-82e9-78d280e5f279'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.130551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a3fc5e40984e518273e20ce6f58e39'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.131804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a426b8e149dc4fbf83a239f30f2e3df5', 'request_id': 'req-13010f17-c2e5-4b7c-82e9-78d280e5f279'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.139151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a426b8e149dc4fbf83a239f30f2e3df5', 'request_id': 'req-13010f17-c2e5-4b7c-82e9-78d280e5f279'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.145532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a3fc5e40984e518273e20ce6f58e39'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.149820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-bb1f4f40-0307-4f39-86c8-015c3411d12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a3fc5e40984e518273e20ce6f58e39'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.224116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] The token cache is being invalidate because project a426b8e149dc4fbf83a239f30f2e3df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:49.224472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.225118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-13010f17-c2e5-4b7c-82e9-78d280e5f279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:49.226898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1218/2431] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:48 2022] DELETE /identity/v3/projects/a426b8e149dc4fbf83a239f30f2e3df5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:49.231834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ba11-cc3b-4f17-be81-57f58a5cd54e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.232240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ba11-cc3b-4f17-be81-57f58a5cd54e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.233154 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ba11-cc3b-4f17-be81-57f58a5cd54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.256803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5531ba11-cc3b-4f17-be81-57f58a5cd54e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:49.258251 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5531ba11-cc3b-4f17-be81-57f58a5cd54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:49.283989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1214/2432] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:48 2022] DELETE /identity/v3/users/80a3fc5e40984e518273e20ce6f58e39 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:49.288968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.289328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.289727 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.311487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:49.316346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:49.350067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1219/2433] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:49.351672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.351956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.352291 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.389773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:49.391103 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:49.402741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1215/2434] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:49.413805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.415288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:49.480487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1220/2435] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:49.485477 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.497652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692b73-02b4-463b-ba97-53eb15dee5aa None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.505842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.506583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.506979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.507362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.508328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:49.508840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:49.511475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.531518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf6879-992e-4f3a-a04e-0598cf45a99a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.533959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1221/2436] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:45:49.538315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.540346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.541102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.541431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.541710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.553506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:49.555007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.557568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6c26-604a-4522-b8fe-d63b91999638 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.566077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1216/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:49.569768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.571281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.572544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.572945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.574105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:49.577597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.695601 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1222/2438] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:49 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:49.699813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.711383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1549c4-75df-40ef-a06c-316275241459 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.728678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:49.770360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.787429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.787429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.787429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.787429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:49.787429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.898692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1217/2439] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:49 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:49.899295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.914038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d855bb3-8405-453c-8790-9fa02b3ef32a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.920586 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.921381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.922429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.922725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.923437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:49.925123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.940988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1223/2440] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:49.944705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.956199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476631-31f8-4509-838d-7efdebe2355d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.961619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.962682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.963583 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:49.963964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:49.964811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:49.970902 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:49.977504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1218/2441] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:49.981646 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:49.992447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d541f-2e6d-4a70-909d-b1a79e4adc50 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:49.999956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabb819-8684-45f1-8314-5abaf8d127ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:49.999956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb819-8684-45f1-8314-5abaf8d127ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:49.999956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb819-8684-45f1-8314-5abaf8d127ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:50.000245 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb819-8684-45f1-8314-5abaf8d127ac admin admin] PATH_INFO: `/v3/projects/1cef113fb0b54714b3a420a0a7d99f33/users/e88ab22482184323be3a9f7a720f917a/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:50.027350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:50.029793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:50.040898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabb819-8684-45f1-8314-5abaf8d127ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cef113fb0b54714b3a420a0a7d99f33, user_id=e88ab22482184323be3a9f7a720f917a, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:50.045319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabb819-8684-45f1-8314-5abaf8d127ac admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:50.048753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:50.071766 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e382d-a80b-4ef1-a4f5-61c7aeb8e55c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:50.078536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:50.079839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:50.080695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:50.081636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] PATH_INFO: `/v3/projects/de18ed4b287144a0be001a65b293c016` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:50.083575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de18ed4b287144a0be001a65b293c016)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:50.085693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:50.129131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1224/2442] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:49 2022] PUT /identity/v3/projects/1cef113fb0b54714b3a420a0a7d99f33/users/e88ab22482184323be3a9f7a720f917a/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:50.142708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:50.143016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:50.143288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:50.174221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] MFA Rules not processed for user `e88ab22482184323be3a9f7a720f917a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:50.175452 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:50.200024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de18ed4b287144a0be001a65b293c016', 'request_id': 'req-e4718b83-5cff-4615-931a-6d39975572b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.212432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de18ed4b287144a0be001a65b293c016', 'request_id': 'req-e4718b83-5cff-4615-931a-6d39975572b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.219937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de18ed4b287144a0be001a65b293c016', 'request_id': 'req-e4718b83-5cff-4615-931a-6d39975572b5'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.264479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1225/2443] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:50.275977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] The token cache is being invalidate because project de18ed4b287144a0be001a65b293c016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:50.276394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.277224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.278828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:50.279287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1219/2444] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:50 2022] DELETE /identity/v3/projects/de18ed4b287144a0be001a65b293c016 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:50.283857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:50.286683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:50.291366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:50.354282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02c72-399f-4fb2-82f4-c4508bc41321 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:50.367198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718b83-5cff-4615-931a-6d39975572b5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:50.374586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:50.375486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:50.375867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:50.376218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] PATH_INFO: `/v3/users/da197496bdf34716b5313dcc3eb6839a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:50.377620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da197496bdf34716b5313dcc3eb6839a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:50.379920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:50.405607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:50.414990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:50.415649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:50.415934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:50.416400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:50.418305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:50.476263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:50.479820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:50.481310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:50.491015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1226/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:50.525634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da197496bdf34716b5313dcc3eb6839a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.526342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da197496bdf34716b5313dcc3eb6839a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.534745 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da197496bdf34716b5313dcc3eb6839a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.560190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da197496bdf34716b5313dcc3eb6839a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.560190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-407771c8-c93d-42e2-9872-ac4f1bd9547c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da197496bdf34716b5313dcc3eb6839a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:50.635387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1220/2446] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:50 2022] DELETE /identity/v3/users/da197496bdf34716b5313dcc3eb6839a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:51.016005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.034081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ce0b-b4f9-43ef-a339-f0d98dc83407 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.115158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.115812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.116097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.116375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] PATH_INFO: `/v3/projects/0cbfbacc31cb41428acbd3b3c5702265` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.117574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbfbacc31cb41428acbd3b3c5702265)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.119531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:51.276055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbfbacc31cb41428acbd3b3c5702265', 'request_id': 'req-1150f936-28ba-4346-8f4d-d846c5f18669'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:51.282768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbfbacc31cb41428acbd3b3c5702265', 'request_id': 'req-1150f936-28ba-4346-8f4d-d846c5f18669'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:51.288987 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbfbacc31cb41428acbd3b3c5702265', 'request_id': 'req-1150f936-28ba-4346-8f4d-d846c5f18669'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:51.360951 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] The token cache is being invalidate because project 0cbfbacc31cb41428acbd3b3c5702265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:51.361242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:51.361982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1150f936-28ba-4346-8f4d-d846c5f18669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:51.363503 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1227/2447] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:51 2022] DELETE /identity/v3/projects/0cbfbacc31cb41428acbd3b3c5702265 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:51.368511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.369028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.369270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.390938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:51.392161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:51.454334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1221/2448] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:51.470249 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.470596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.470891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.491669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:51.492922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:51.501691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1228/2449] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:51.505888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.521254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41658b9-a7b6-4f11-9425-b948e4168b2a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.522913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.523555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.523839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.524181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.524830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:51.525137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.526743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:51.539913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1222/2450] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:51.544313 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.556918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e997d85-be1f-48ac-b2a9-130b0b1043d8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.564052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.564902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.565525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.565525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.566701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.568711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:51.638749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1229/2451] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:51.643176 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.653646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6688cb-5b55-4647-9ba4-edab75590359 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.714883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.715642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.716001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.716376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.717309 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.719396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:51.833462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1223/2452] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:51 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:51.834975 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.845626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2617415-c1f8-43e2-b144-731e87286221 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.850608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.851230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.851518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.851795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.852491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.854139 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:51.866469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1230/2453] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:51.870514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.881866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccc5d2-7fe5-4666-aa20-7db06ed733af admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.886624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62478218-03ec-445c-b612-e59dfba1f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.887256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478218-03ec-445c-b612-e59dfba1f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.887538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478218-03ec-445c-b612-e59dfba1f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.887812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478218-03ec-445c-b612-e59dfba1f6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.889124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62478218-03ec-445c-b612-e59dfba1f6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.890552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62478218-03ec-445c-b612-e59dfba1f6bc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:51.901610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1224/2454] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:51.905955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:51.916418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3f7e-d5bc-48b6-8cc5-ce7bd0302c81 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:51.921850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:51.922512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:51.922806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:51.923063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] PATH_INFO: `/v3/projects/c81307202f694c1dafad963211e15de0/users/2b7e099a5f1a4a9780d1928399be9054/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:51.938188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81307202f694c1dafad963211e15de0, user_id=2b7e099a5f1a4a9780d1928399be9054, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:51.940872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.053575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1231/2455] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:51 2022] PUT /identity/v3/projects/c81307202f694c1dafad963211e15de0/users/2b7e099a5f1a4a9780d1928399be9054/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:52.065677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.066051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.066238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.081262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:52.097799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] MFA Rules not processed for user `2b7e099a5f1a4a9780d1928399be9054`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:52.099068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:52.167824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1225/2456] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:52.173340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.194727 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:52.241663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f3a3-fa8d-40e3-b179-cf8e9940aa79 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:52.246420 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:52.247037 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.247343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.247600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.248498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:52.250459 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.347200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1232/2457] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:52 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:52.351034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.364590 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223d75b-c56e-441b-b46e-f8e7959a2937 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:52.424310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:52.424987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.425248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.425525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.426204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:52.428228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.545565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1226/2458] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:52 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:52.549661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.560378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb3cf1-50f5-4fde-94d9-443ad9698751 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:52.565093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:52.565693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.565973 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.567623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.567623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:52.568565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.580815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1233/2459] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:52.584964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.595666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f354d9-e6c1-406a-9ddc-7ca13f4cd9f6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:52.600700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:52.601387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.601675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.601961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] PATH_INFO: `/v3/projects/fe210ea0f4a9485599506d9d6da978c5/users/4248c50fbf694580996d56716dcc3aaa/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.617132 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe210ea0f4a9485599506d9d6da978c5, user_id=4248c50fbf694580996d56716dcc3aaa, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:52.620016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.693417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1227/2460] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:52 2022] PUT /identity/v3/projects/fe210ea0f4a9485599506d9d6da978c5/users/4248c50fbf694580996d56716dcc3aaa/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:52.697737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.708441 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc08fcf-87b3-464f-8e57-d40f0e9723f1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:52.768343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de199-034f-4cae-91d2-34a75794c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:52.769008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de199-034f-4cae-91d2-34a75794c632 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.769318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de199-034f-4cae-91d2-34a75794c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.769564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de199-034f-4cae-91d2-34a75794c632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.770262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de199-034f-4cae-91d2-34a75794c632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:52.771947 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de199-034f-4cae-91d2-34a75794c632 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.784876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1234/2461] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:52.789140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.799999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165815ef-0c0c-4af3-b9e4-23f336591cf5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:52.804759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:52.805414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.805700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.811918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] PATH_INFO: `/v3/projects/fe210ea0f4a9485599506d9d6da978c5/users/4248c50fbf694580996d56716dcc3aaa/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.811918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe210ea0f4a9485599506d9d6da978c5, user_id=4248c50fbf694580996d56716dcc3aaa, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:52.811918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:52.822005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1228/2462] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:52 2022] PUT /identity/v3/projects/fe210ea0f4a9485599506d9d6da978c5/users/4248c50fbf694580996d56716dcc3aaa/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:52.833162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:52.833495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:52.840657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:52.861932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] MFA Rules not processed for user `4248c50fbf694580996d56716dcc3aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:52.863194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:52.934567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1235/2463] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:52.945999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:52.947673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.002894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:53.006749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe4a9b-5837-4dd6-a147-03fe6b6502a3 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:53.010572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:53.011212 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.011493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.011767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.021422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:53.022844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:53.032123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1229/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:53.169304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:53.188100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:53.231242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e905f3-a154-403f-be45-b99a29b020b1 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:53.236495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:53.237167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.237476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.237749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] PATH_INFO: `/v3/users/2b7e099a5f1a4a9780d1928399be9054` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.238892 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7e099a5f1a4a9780d1928399be9054)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:53.240917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:53.430156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7e099a5f1a4a9780d1928399be9054'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.448383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:53.449970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.463910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e6e0b-fb01-4428-8ef2-6e85ae72909e service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:53.469362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:53.470001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.470758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.470758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] PATH_INFO: `/v3/users/e88ab22482184323be3a9f7a720f917a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.471897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88ab22482184323be3a9f7a720f917a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:53.473920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:53.515953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7e099a5f1a4a9780d1928399be9054'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.523451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7e099a5f1a4a9780d1928399be9054'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.524074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7e099a5f1a4a9780d1928399be9054'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.524675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-0c419097-0412-4c65-9276-22931ead2463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7e099a5f1a4a9780d1928399be9054'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.542889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1236/2465] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:53 2022] DELETE /identity/v3/users/2b7e099a5f1a4a9780d1928399be9054 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:53.547986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.548272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.548547 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.566839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:53.568030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.630484 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1237/2466] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:53.640650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:53.642163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.680708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88ab22482184323be3a9f7a720f917a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.681488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88ab22482184323be3a9f7a720f917a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.685365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:53.689371 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88ab22482184323be3a9f7a720f917a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.701934 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88ab22482184323be3a9f7a720f917a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.702936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5644d-0094-466e-8dbd-05e7d7460014 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:53.703090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88ab22482184323be3a9f7a720f917a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:53.706596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:53.707215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.707498 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.707773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.709579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.721912 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:53.724049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38129c9-6e38-4397-9c1c-169948a0de0f service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:53.734098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1238/2467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:53.807355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1230/2468] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:53 2022] DELETE /identity/v3/users/e88ab22482184323be3a9f7a720f917a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:53.811822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.812117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.812391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.834043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:53.835264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.894592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1239/2469] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:53.904975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:53.906432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:53.966092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2cbc4-c038-481b-a570-a0bc18e90365 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:53.971086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:53.971720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:53.975701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:53.975701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:53.984343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:53.985938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:53.997064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1231/2470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:54.225565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:54.226969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:54.239941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72223bc-f7d6-4142-9b67-e3f47c5c0a83 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:54.246478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:54.247714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:54.248042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:54.248521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] PATH_INFO: `/v3/projects/c81307202f694c1dafad963211e15de0` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:54.251007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81307202f694c1dafad963211e15de0)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:54.251736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:54.346211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81307202f694c1dafad963211e15de0', 'request_id': 'req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.352630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81307202f694c1dafad963211e15de0', 'request_id': 'req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.358832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81307202f694c1dafad963211e15de0', 'request_id': 'req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.434153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] The token cache is being invalidate because project c81307202f694c1dafad963211e15de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:54.434548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.435224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.436666 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:54.437285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1240/2471] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:54 2022] DELETE /identity/v3/projects/c81307202f694c1dafad963211e15de0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:54.438270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:54.440891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:54.442228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:54.463296 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685686b-a31c-4810-aea6-347918615020 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:54.518188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc2c05-a777-4ea6-828d-5caa12b60cf4 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:54.522895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:54.523534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:54.523811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:54.524082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] PATH_INFO: `/v3/users/4248c50fbf694580996d56716dcc3aaa` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:54.524687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:54.525278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4248c50fbf694580996d56716dcc3aaa)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:54.525521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:54.525977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:54.526329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] PATH_INFO: `/v3/projects/1cef113fb0b54714b3a420a0a7d99f33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:54.527209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:54.527701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cef113fb0b54714b3a420a0a7d99f33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:54.530192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:54.530582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:54.538609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:54.720564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4248c50fbf694580996d56716dcc3aaa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.725992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cef113fb0b54714b3a420a0a7d99f33', 'request_id': 'req-6575975a-4b08-48fb-a01c-6772307622d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.740168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cef113fb0b54714b3a420a0a7d99f33', 'request_id': 'req-6575975a-4b08-48fb-a01c-6772307622d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.746614 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cef113fb0b54714b3a420a0a7d99f33', 'request_id': 'req-6575975a-4b08-48fb-a01c-6772307622d7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.774362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4248c50fbf694580996d56716dcc3aaa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.785959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4248c50fbf694580996d56716dcc3aaa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.785959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4248c50fbf694580996d56716dcc3aaa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.785959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-645c54e4-b1a7-4adc-b9f8-ceb9b0aea2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4248c50fbf694580996d56716dcc3aaa'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.802831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1241/2472] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:54 2022] DELETE /identity/v3/users/4248c50fbf694580996d56716dcc3aaa => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:54.851163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] The token cache is being invalidate because project 1cef113fb0b54714b3a420a0a7d99f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:54.851163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.851163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6575975a-4b08-48fb-a01c-6772307622d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:54.852196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1232/2473] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:54 2022] DELETE /identity/v3/projects/1cef113fb0b54714b3a420a0a7d99f33 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:54.857520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:54.857520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:54.857867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:54.879946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:54.881476 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:54.942978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1242/2474] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:54.950826 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:54.951647 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:54.951937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:54.972035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:54.973287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:54.981624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1233/2475] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:54.986068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:54.996522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6963fe6-ab01-40ef-bde0-defea81c10c0 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.002076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.002833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.003121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.003399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.004125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:55.004433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.006147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.022023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1243/2476] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:55.023126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.032560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c860b-30bd-4972-bef1-ed6f4257d509 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.037348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.037971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.038259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.038534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.039237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.041201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.134792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1234/2477] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:55.139840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.150560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5054c-890d-4fe2-88e3-34950fca2879 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.219065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.219625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.219907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.220180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.220981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.223034 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.290512 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.292786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:55.299691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:55.307892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bf58-83b9-41c4-9336-3014d0a99fa4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.309288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1244/2478] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:55.313320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.316001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.316860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.317252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.317637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] PATH_INFO: `/v3/projects/fe210ea0f4a9485599506d9d6da978c5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.319427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe210ea0f4a9485599506d9d6da978c5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.321574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.324767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3709d80-65ae-4ab0-ad4a-9bc48bd83ed5 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.330020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.330661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.330972 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.331209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.331917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.333605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.346272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1245/2479] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:55.350653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.362479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fbc2f-f565-4689-9b01-1286cf41ac27 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.367165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.370280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.370280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.370280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.370280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.370790 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.382073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1246/2480] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:55.386382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.397170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120ef2-1830-4e42-8283-baf938272c64 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.401831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a73124-4894-4036-ab81-3bb020c1187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.402537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73124-4894-4036-ab81-3bb020c1187f admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.402817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73124-4894-4036-ab81-3bb020c1187f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.403088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73124-4894-4036-ab81-3bb020c1187f admin admin] PATH_INFO: `/v3/projects/ef9ff2f35c2e4eff989f646dce54dbe2/users/f4344539eb8f4719a137c4a164ac6002/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.417881 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a73124-4894-4036-ab81-3bb020c1187f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9ff2f35c2e4eff989f646dce54dbe2, user_id=f4344539eb8f4719a137c4a164ac6002, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.421457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a73124-4894-4036-ab81-3bb020c1187f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.506874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1247/2481] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:55 2022] PUT /identity/v3/projects/ef9ff2f35c2e4eff989f646dce54dbe2/users/f4344539eb8f4719a137c4a164ac6002/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:55.514783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe210ea0f4a9485599506d9d6da978c5', 'request_id': 'req-6d4da32e-e449-483e-98c5-87ccf7d36767'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:55.518168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.518462 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.518772 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.521677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe210ea0f4a9485599506d9d6da978c5', 'request_id': 'req-6d4da32e-e449-483e-98c5-87ccf7d36767'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:55.527617 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe210ea0f4a9485599506d9d6da978c5', 'request_id': 'req-6d4da32e-e449-483e-98c5-87ccf7d36767'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:55.549991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] MFA Rules not processed for user `f4344539eb8f4719a137c4a164ac6002`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:55.551195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:55.614233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1248/2482] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:55.625470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] The token cache is being invalidate because project fe210ea0f4a9485599506d9d6da978c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:55.625781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:55.626489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d4da32e-e449-483e-98c5-87ccf7d36767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:55.628280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.628280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:55.628557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1235/2483] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:55 2022] DELETE /identity/v3/projects/fe210ea0f4a9485599506d9d6da978c5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:55.632639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2fe6d-3d42-45da-bbdf-483fe246aef4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.633172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2fe6d-3d42-45da-bbdf-483fe246aef4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.633462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2fe6d-3d42-45da-bbdf-483fe246aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.655270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-76b2fe6d-3d42-45da-bbdf-483fe246aef4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:55.656564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-76b2fe6d-3d42-45da-bbdf-483fe246aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:55.688108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d7f4-8853-4223-aa9a-e4e629c46b17 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.691991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9429e0cfd94f279a255fff511a4737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.692608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.692922 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.693198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.694959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:55.703301 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:55.706985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.708488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.717940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1236/2484] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:55.725160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1249/2485] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:55.726658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.726944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.727221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.747475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:55.749432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:55.760876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1237/2486] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:55.763918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.775645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f48c96-ca95-4019-80e4-4ebe8d131a14 service glance] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.781116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.781729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.782130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.787522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.787522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:45:55.787522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.787522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.800842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1250/2487] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:45:55.802363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.812664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5479d-ceef-4f2b-8192-71a65dd830e0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.817525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.820238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.820238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.820238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.820238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.821317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:55.913979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1238/2488] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:55.915988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:55.926721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d1ca4-e081-44f2-88f6-dbb42b3143f9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:55.957653 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:55.986447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:55.987195 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:55.987550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:55.987854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:55.988520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:55.990520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.117353 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1251/2489] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:55 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:56.121532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.132386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbc022-7b6c-4337-b24f-2167612f4ab5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.137007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.137620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.137910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.138191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.138890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.140476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.150482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1239/2490] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:45:56.154571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.164424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc9bc-5041-4917-8224-18e3b19916e0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.170217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.170787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.170986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.171271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.171967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.173599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.188576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1252/2491] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:56.190178 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.200816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f52fb-bf7e-4312-9f4d-3347dc1d3652 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.205819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcbaaf-5bf0-408c-87df-77c17a75f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.206485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcbaaf-5bf0-408c-87df-77c17a75f87f admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.206773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcbaaf-5bf0-408c-87df-77c17a75f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.207058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcbaaf-5bf0-408c-87df-77c17a75f87f admin admin] PATH_INFO: `/v3/projects/e481db81572a4933b42ba01c73108e70/users/2f930c1ff2fb4040a34e8cc4ac46cb6a/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.234260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcbaaf-5bf0-408c-87df-77c17a75f87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e481db81572a4933b42ba01c73108e70, user_id=2f930c1ff2fb4040a34e8cc4ac46cb6a, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.237157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcbaaf-5bf0-408c-87df-77c17a75f87f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.268143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.269989 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:56.328114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1240/2492] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:56 2022] PUT /identity/v3/projects/e481db81572a4933b42ba01c73108e70/users/2f930c1ff2fb4040a34e8cc4ac46cb6a/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:56.329432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f555-bacd-4714-a4ca-447f1ebce022 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.340363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.340915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.341504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.370581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] MFA Rules not processed for user `2f930c1ff2fb4040a34e8cc4ac46cb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:56.371777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:56.383655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.384395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.384667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.384974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.386779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:56.442207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1241/2493] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:45:56.446851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.452686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.454166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.459470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f6312-cc77-4944-ad1f-636ec32cb9f8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.464060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1253/2494] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:45:56.464181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.464909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.465194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.465543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.466215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.468669 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.583737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1242/2495] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:45:56 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:45:56.585758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.596335 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83847c-36b1-4e0c-aa13-efc501ca7855 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.609836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:56.662038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.662883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.663426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.663637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.664338 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.666372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.733825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1254/2496] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:45:56 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:45:56.738066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.749932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32a9-920e-4356-9d05-ee00d74420e1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.762194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.762194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.762194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.762194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.762571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.762571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.772622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1243/2497] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:56.774067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.785495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64601636-72fe-4b69-95c7-d4465d6c13a7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.790668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.791334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.791616 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.791891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] PATH_INFO: `/v3/projects/c5b9ec98234d496b97135748c59553a4/users/79e4daa13b1a415b9875fba7602e353f/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.807695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b9ec98234d496b97135748c59553a4, user_id=79e4daa13b1a415b9875fba7602e353f, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.810599 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.900424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1255/2498] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:56 2022] PUT /identity/v3/projects/c5b9ec98234d496b97135748c59553a4/users/79e4daa13b1a415b9875fba7602e353f/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:56.905339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:56.916586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d7f7-54db-4edd-849c-ce6a45786812 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:56.963137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:56.980949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27bcd8-0f85-418b-8aa5-3fe89302be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:56.981616 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bcd8-0f85-418b-8aa5-3fe89302be7b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:56.981867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bcd8-0f85-418b-8aa5-3fe89302be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:56.982302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bcd8-0f85-418b-8aa5-3fe89302be7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:56.983182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27bcd8-0f85-418b-8aa5-3fe89302be7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:56.984810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27bcd8-0f85-418b-8aa5-3fe89302be7b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:56.998250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1244/2499] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:45:57.000160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:57.011406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327e1ac-2e0a-4f02-b652-e0c456700220 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:57.017131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:57.017875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:57.018240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:57.018579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] PATH_INFO: `/v3/projects/c5b9ec98234d496b97135748c59553a4/users/79e4daa13b1a415b9875fba7602e353f/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:57.020623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b9ec98234d496b97135748c59553a4, user_id=79e4daa13b1a415b9875fba7602e353f, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:57.023381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:57.035004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1256/2500] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:45:56 2022] PUT /identity/v3/projects/c5b9ec98234d496b97135748c59553a4/users/79e4daa13b1a415b9875fba7602e353f/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:45:57.046274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:57.046572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:57.046858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:57.078913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] MFA Rules not processed for user `79e4daa13b1a415b9875fba7602e353f`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:57.080092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:57.152919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1245/2501] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:57.165673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:57.167324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:57.236002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1907-48e1-460b-ade0-109e487013cb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:57.239962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:57.240655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:57.240968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:57.241244 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:57.251429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:57.253065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:57.264537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1257/2502] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:57.416929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:57.430119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d492c2-a262-4199-92cc-050aaf3388f2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:57.433919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed3c3-12a5-4a76-8b6b-55dde40c0ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:57.434703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed3c3-12a5-4a76-8b6b-55dde40c0ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:57.434995 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed3c3-12a5-4a76-8b6b-55dde40c0ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:57.435276 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed3c3-12a5-4a76-8b6b-55dde40c0ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:57.510302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beed3c3-12a5-4a76-8b6b-55dde40c0ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:57.511790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beed3c3-12a5-4a76-8b6b-55dde40c0ef1 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:57.522006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1246/2503] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:58.043643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:58.115943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2ec43-f1b6-4ef8-9f9a-85f18d8be7b6 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:58.120407 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:58.121070 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:58.121348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:58.121617 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] PATH_INFO: `/v3/users/2f930c1ff2fb4040a34e8cc4ac46cb6a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:58.122813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f930c1ff2fb4040a34e8cc4ac46cb6a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:58.125203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:58.139319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:58.291424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f930c1ff2fb4040a34e8cc4ac46cb6a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:58.362250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f930c1ff2fb4040a34e8cc4ac46cb6a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:58.372423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f930c1ff2fb4040a34e8cc4ac46cb6a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:58.373344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f930c1ff2fb4040a34e8cc4ac46cb6a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:58.374020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f930c1ff2fb4040a34e8cc4ac46cb6a'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:58.398670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1258/2504] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:58 2022] DELETE /identity/v3/users/2f930c1ff2fb4040a34e8cc4ac46cb6a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:58.400598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:58.401453 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:58.401737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:58.427048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:45:58.428269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:58.512776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1247/2505] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:45:58.521097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:58.522552 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:58.592551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a39ed7-7fc0-40dd-99de-ff3dd1fe57d2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:58.596926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:58.597797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:58.597993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:58.598398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:58.610720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:58.612196 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:58.624513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1259/2506] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:45:59.227805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:59.230342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:45:59.242940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:59.259608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced295b-37f8-405a-a209-b82dbc5b8c8c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:59.270312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:59.270312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:59.270312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:59.270312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] PATH_INFO: `/v3/projects/e481db81572a4933b42ba01c73108e70` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:59.270642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e481db81572a4933b42ba01c73108e70)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:59.272546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:59.419470 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e481db81572a4933b42ba01c73108e70', 'request_id': 'req-c6db14a9-ebb8-4241-b76f-990868650944'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.425988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e481db81572a4933b42ba01c73108e70', 'request_id': 'req-c6db14a9-ebb8-4241-b76f-990868650944'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.439800 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e481db81572a4933b42ba01c73108e70', 'request_id': 'req-c6db14a9-ebb8-4241-b76f-990868650944'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.521874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] The token cache is being invalidate because project e481db81572a4933b42ba01c73108e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:45:59.522118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.522741 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.524252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1248/2507] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:45:59 2022] DELETE /identity/v3/projects/e481db81572a4933b42ba01c73108e70 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:45:59.528315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:45:59.538183 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d521-92db-47bf-b4e8-87ac314abede service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:45:59.599380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:45:59.600000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:45:59.600548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:45:59.600856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] PATH_INFO: `/v3/users/79e4daa13b1a415b9875fba7602e353f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:45:59.602031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e4daa13b1a415b9875fba7602e353f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:45:59.604109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:45:59.801404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:59.814916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e4daa13b1a415b9875fba7602e353f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.881943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e4daa13b1a415b9875fba7602e353f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.890213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e4daa13b1a415b9875fba7602e353f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.890801 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e4daa13b1a415b9875fba7602e353f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.891500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e4daa13b1a415b9875fba7602e353f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:45:59.916872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1260/2508] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:45:59 2022] DELETE /identity/v3/users/79e4daa13b1a415b9875fba7602e353f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:00.547367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:00.549968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:00.585656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db14a9-ebb8-4241-b76f-990868650944 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:00.649561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:00.652579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:00.671860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:00.672521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:00.672838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:00.673121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] PATH_INFO: `/v3/projects/c5b9ec98234d496b97135748c59553a4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:00.674300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b9ec98234d496b97135748c59553a4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:00.676304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:00.723387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea8af5-c830-47ab-8da3-2b0c1c7487a7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:00.729608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:00.730283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:00.730564 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:00.730840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] PATH_INFO: `/v3/users/f5ab7ab8489b45c3af75187da20695af` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:00.732569 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ab7ab8489b45c3af75187da20695af)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:00.734577 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:00.806784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b9ec98234d496b97135748c59553a4', 'request_id': 'req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:00.816062 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b9ec98234d496b97135748c59553a4', 'request_id': 'req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:00.827998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b9ec98234d496b97135748c59553a4', 'request_id': 'req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:00.978034 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] The token cache is being invalidate because project c5b9ec98234d496b97135748c59553a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:00.978509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:00.979147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-114cdf20-5c96-4a4a-9af1-c2f213f5aa10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:00.980701 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1249/2509] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:00 2022] DELETE /identity/v3/projects/c5b9ec98234d496b97135748c59553a4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:00.986482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2e1db-d431-44c0-bdfb-341f5064e68d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:00.986776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2e1db-d431-44c0-bdfb-341f5064e68d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:00.987171 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2e1db-d431-44c0-bdfb-341f5064e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:00.990688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ab7ab8489b45c3af75187da20695af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.006342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a7f2e1db-d431-44c0-bdfb-341f5064e68d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:01.007581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a7f2e1db-d431-44c0-bdfb-341f5064e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.019769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:01.067994 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1250/2510] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:01.069830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ab7ab8489b45c3af75187da20695af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.077460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.077643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ab7ab8489b45c3af75187da20695af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.077762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.078047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.078243 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ab7ab8489b45c3af75187da20695af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.078852 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ab7ab8489b45c3af75187da20695af'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.097817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1261/2511] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:00 2022] DELETE /identity/v3/users/f5ab7ab8489b45c3af75187da20695af => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:01.098726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:01.101952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.166228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1251/2512] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:01.171271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.181120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3874f-0e95-4fde-8578-b276ac5932de admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.186391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.187014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.187298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.187575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.188270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:01.188592 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.190253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.204683 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1262/2513] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:01.208963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.218452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691b369-6769-4f2e-bd5e-ee1b39fb49a1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.223091 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.223708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.223989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.224284 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.224977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.227134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.334534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1252/2514] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:01.338810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.349024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5783c-29ff-4ba4-b375-55214200dcab admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.362807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:01.369463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.371622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.414757 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.415396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.415848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.416129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.416928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.418880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.453316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7329-76b3-4dc1-9127-e3b714c2c352 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.458033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.458676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.458962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.459241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] PATH_INFO: `/v3/projects/53b658685abd4e59ab88c2a2736c6a38` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.460432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b658685abd4e59ab88c2a2736c6a38)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.462378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.545082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1263/2515] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:01.549119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.559318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4f22-5dbf-474d-b2f5-dbb312872b2f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.566316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.566950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.567285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.567565 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.568273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.569915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.573841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:01.580774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b658685abd4e59ab88c2a2736c6a38', 'request_id': 'req-76eee195-16f1-4b32-93e4-4bc18c42abe7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.581500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1264/2516] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:01.585397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.587349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b658685abd4e59ab88c2a2736c6a38', 'request_id': 'req-76eee195-16f1-4b32-93e4-4bc18c42abe7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.593103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b658685abd4e59ab88c2a2736c6a38', 'request_id': 'req-76eee195-16f1-4b32-93e4-4bc18c42abe7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.595409 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb2ccf-bf84-4c84-8477-dcbdc87a62f8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.654722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.655377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.655536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.655809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.656499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.658235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.668014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1265/2517] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:01.672804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.675777 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] The token cache is being invalidate because project 53b658685abd4e59ab88c2a2736c6a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:01.676076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.676739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-76eee195-16f1-4b32-93e4-4bc18c42abe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:01.678468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1253/2518] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:01 2022] DELETE /identity/v3/projects/53b658685abd4e59ab88c2a2736c6a38 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:01.682967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edce68-6058-48d9-8ec9-85d7f2ad71b9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.692163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f2e6c-d817-4328-8b57-ebb38b80a1af None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.692455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f2e6c-d817-4328-8b57-ebb38b80a1af None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.692774 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f2e6c-d817-4328-8b57-ebb38b80a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.695839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882b04d-ccaf-4230-b4df-4b1cf632f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.696566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882b04d-ccaf-4230-b4df-4b1cf632f872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.696877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882b04d-ccaf-4230-b4df-4b1cf632f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.697164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882b04d-ccaf-4230-b4df-4b1cf632f872 admin admin] PATH_INFO: `/v3/projects/31dfbb55b9da44db955c8c643f24b185/users/978b7431ddae4a63b5ab7a43aa2f9c06/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.712594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882b04d-ccaf-4230-b4df-4b1cf632f872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dfbb55b9da44db955c8c643f24b185, user_id=978b7431ddae4a63b5ab7a43aa2f9c06, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.714834 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-bd5f2e6c-d817-4328-8b57-ebb38b80a1af None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:01.715285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882b04d-ccaf-4230-b4df-4b1cf632f872 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.716040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bd5f2e6c-d817-4328-8b57-ebb38b80a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.725866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1254/2519] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:01.735078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.735367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.735646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.755159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:01.756367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.764710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1255/2520] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:01.769227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.779316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd22-caa2-4c4a-987d-eb17c7542341 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.783957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.784552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.784871 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.785149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.785838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:01.786144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.787720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.800081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1256/2521] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:01.804377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.813705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146b3cf-0ff1-480f-96be-6094790f6033 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:01.818310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:01.818892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.819179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.819459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.820105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:01.822004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:01.844818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1266/2522] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:01 2022] PUT /identity/v3/projects/31dfbb55b9da44db955c8c643f24b185/users/978b7431ddae4a63b5ab7a43aa2f9c06/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:01.854418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:01.854707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:01.854990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:01.883242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] MFA Rules not processed for user `978b7431ddae4a63b5ab7a43aa2f9c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:01.884483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.929750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1257/2523] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:01.933569 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.949529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:01.955121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1267/2524] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:01.968366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:01.968366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:01.998269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ecbc7-d873-44d9-a2d4-1ef22c451f5e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.003061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.003681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.003966 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.004246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.004961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.006878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.033221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ff28-49f0-44ae-ad58-defc32ee2855 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.079287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1258/2525] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:01 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:02.080878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.087068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.093698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.093698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.093698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.094013 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297a71-f448-4bbc-a54f-f6e24ee55518 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.095908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.096518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.096838 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.097262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.097965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.099564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.110129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1259/2526] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:02.114115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.123905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23dbab-9190-4fb9-9f09-5abaac780c73 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.128630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.129288 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.129573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.129850 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.130775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.132382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.147366 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1260/2527] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:02.151581 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.153085 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.155173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.162337 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c4440-08d9-48c6-b515-99d9e3e6495e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.164241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1268/2528] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:02.167059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869bd4-58f6-490c-860b-0969d5874c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.167718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869bd4-58f6-490c-860b-0969d5874c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.168007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869bd4-58f6-490c-860b-0969d5874c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.168290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869bd4-58f6-490c-860b-0969d5874c42 admin admin] PATH_INFO: `/v3/projects/9e5606a757ed41d695173636d2e289d1/users/e33a7b94e9c04b0198eb7f2185e82ec0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.184410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.184925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869bd4-58f6-490c-860b-0969d5874c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5606a757ed41d695173636d2e289d1, user_id=e33a7b94e9c04b0198eb7f2185e82ec0, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.185958 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:02.187900 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869bd4-58f6-490c-860b-0969d5874c42 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.199567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a238-3890-4628-8814-397703acfec9 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.204804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.205526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.205740 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.206015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] PATH_INFO: `/v3/users/978b7431ddae4a63b5ab7a43aa2f9c06` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.207271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978b7431ddae4a63b5ab7a43aa2f9c06)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.209644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.258482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1261/2529] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:02 2022] PUT /identity/v3/projects/9e5606a757ed41d695173636d2e289d1/users/e33a7b94e9c04b0198eb7f2185e82ec0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:02.269454 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.269753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.270070 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.298952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] MFA Rules not processed for user `e33a7b94e9c04b0198eb7f2185e82ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:02.300193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:02.310225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:02.369572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1262/2530] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:02.374193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.437973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffd81c-bba6-4643-be7f-1f2ed8039948 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.442599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.443225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.443540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.443819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.444487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.446487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.455492 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978b7431ddae4a63b5ab7a43aa2f9c06'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:02.549339 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978b7431ddae4a63b5ab7a43aa2f9c06'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:02.558051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1263/2531] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:02 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:02.562320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.562525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978b7431ddae4a63b5ab7a43aa2f9c06'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:02.563298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978b7431ddae4a63b5ab7a43aa2f9c06'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:02.563948 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6d36eeb5-cf52-40aa-ad80-ca6fbbf2e475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978b7431ddae4a63b5ab7a43aa2f9c06'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:02.565267 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:02.583232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1269/2532] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:02 2022] DELETE /identity/v3/users/978b7431ddae4a63b5ab7a43aa2f9c06 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:02.587478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.587769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.588051 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.608097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:02.609340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:02.625924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a564a9-a077-435d-a6ff-7ec0446c0ad7 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.670559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:02.672721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1270/2533] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:02.686187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.686979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.687275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.687551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.687946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.688277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.689320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:02.690219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.749472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddd794-bbea-4845-8463-b20032a1280d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.753190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.753809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.754091 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.754365 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.764381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.765929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.775357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1271/2534] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:02.788226 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1264/2535] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:02 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:02.789320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.790834 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:02.808969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df00661-24b6-4ab9-a49b-4f3d5c64e22b service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.814410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.815032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.815442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.815724 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.816419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.818168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.832217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1272/2536] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:02.833439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.844681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c5c8-2c0e-465a-a91c-76668f9ab94e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:02.849414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:02.850088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:02.850639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:02.850922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] PATH_INFO: `/v3/projects/0bf126d0dd584b87b301134466d56593/users/4dd0cc34726f478790647499be095316/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:02.866439 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf126d0dd584b87b301134466d56593, user_id=4dd0cc34726f478790647499be095316, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:02.869279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:02.943530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1265/2537] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:02 2022] PUT /identity/v3/projects/0bf126d0dd584b87b301134466d56593/users/4dd0cc34726f478790647499be095316/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:02.946884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:02.958609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b776-6378-4230-84b7-549325a72282 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.021615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cde3-08e1-4a15-bc03-95694a78ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.022238 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cde3-08e1-4a15-bc03-95694a78ea88 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.022515 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cde3-08e1-4a15-bc03-95694a78ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.022785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cde3-08e1-4a15-bc03-95694a78ea88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.023478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369cde3-08e1-4a15-bc03-95694a78ea88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.025124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369cde3-08e1-4a15-bc03-95694a78ea88 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.039054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1273/2538] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:03.040197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:03.050523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8361f-628b-4e83-94d0-92d4b6ed3d89 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.055593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.056405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.056697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.057005 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] PATH_INFO: `/v3/projects/0bf126d0dd584b87b301134466d56593/users/4dd0cc34726f478790647499be095316/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.058993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf126d0dd584b87b301134466d56593, user_id=4dd0cc34726f478790647499be095316, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.062044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.074195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1266/2539] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:03 2022] PUT /identity/v3/projects/0bf126d0dd584b87b301134466d56593/users/4dd0cc34726f478790647499be095316/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:03.086754 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.087046 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.087486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.108663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:03.117771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] MFA Rules not processed for user `4dd0cc34726f478790647499be095316`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:03.119030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:03.186157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:03.187920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:03.197053 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1274/2540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:03.210229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:03.220846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:03.268682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deebbb-8a5c-43ba-b78d-d9a3b480dd53 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.273674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.274320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.274612 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.274895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] PATH_INFO: `/v3/projects/31dfbb55b9da44db955c8c643f24b185` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.275431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0596932-78ed-4482-8a60-c64d18f07f80 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.276085 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dfbb55b9da44db955c8c643f24b185)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.278016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.279287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.279929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.280207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.280475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.282256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:03.344488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.345993 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71b84f-1326-4780-980d-30de59ee5ba2 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.356221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1275/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:03.375272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dfbb55b9da44db955c8c643f24b185', 'request_id': 'req-36106e6d-32c9-4123-8f32-8ea8e5650424'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:03.381862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dfbb55b9da44db955c8c643f24b185', 'request_id': 'req-36106e6d-32c9-4123-8f32-8ea8e5650424'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:03.387763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dfbb55b9da44db955c8c643f24b185', 'request_id': 'req-36106e6d-32c9-4123-8f32-8ea8e5650424'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:03.452538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] The token cache is being invalidate because project 31dfbb55b9da44db955c8c643f24b185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:03.452817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:03.455325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36106e6d-32c9-4123-8f32-8ea8e5650424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:03.455892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1267/2542] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:03 2022] DELETE /identity/v3/projects/31dfbb55b9da44db955c8c643f24b185 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:03.460748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.461118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.461465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.481861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:03.484002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:03.529676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:03.547273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1276/2543] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:03.555194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.555504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.555778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.581805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:03.583281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:03.591695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1268/2544] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:03.595761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:03.605935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce682-7af6-447c-a06d-a9ad8c05ecf6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.611215 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.611915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.612220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.614109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.614109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:03.614109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.615532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.629999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1277/2545] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:03.634361 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:03.643857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f199bc-80b1-4d4b-bf30-6dae6018fe99 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.648486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.649127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.649407 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.649767 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.650668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.652338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.761885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:03.769359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1269/2546] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:03 2022] POST /identity/v3/projects => generated 361 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:03.773590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:03.784168 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9599fe-f879-4fd5-b491-df82e6e13b93 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:03.846507 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:03.847133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:03.847423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:03.847717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:03.848378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:03.850591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:03.990516 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1278/2547] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:03 2022] POST /identity/v3/users => generated 281 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:03.994530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:04.005039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390de1e-68b2-4dff-acc4-8be502936934 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:04.009619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:04.011878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.011878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.011878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.012342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:04.013978 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:04.025319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1270/2548] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:04.030282 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:04.041625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e5d9-9d61-4dfa-a54a-dcaef498f755 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:04.048270 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ae8c1-d1b8-478a-b981-3e31963c72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:04.049052 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae8c1-d1b8-478a-b981-3e31963c72f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.049340 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae8c1-d1b8-478a-b981-3e31963c72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.049634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae8c1-d1b8-478a-b981-3e31963c72f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.050899 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ae8c1-d1b8-478a-b981-3e31963c72f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:04.052271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ae8c1-d1b8-478a-b981-3e31963c72f4 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:04.064257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1279/2549] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:04.068189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:04.080065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32959-7ebc-41ec-ba11-4358c2125d22 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:04.086501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:04.088810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.088810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.088810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] PATH_INFO: `/v3/projects/e17bf09af8524fc7b8bd8509ef68f7eb/users/fc10b7c6f11f48759e1bd149c27bb376/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.108265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17bf09af8524fc7b8bd8509ef68f7eb, user_id=fc10b7c6f11f48759e1bd149c27bb376, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:04.111114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:04.195965 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1271/2550] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:04 2022] PUT /identity/v3/projects/e17bf09af8524fc7b8bd8509ef68f7eb/users/fc10b7c6f11f48759e1bd149c27bb376/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:04.266867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.267059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.267325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.299846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] MFA Rules not processed for user `fc10b7c6f11f48759e1bd149c27bb376`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:04.301194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:04.368642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1280/2551] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:04.407570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:04.409389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:04.464827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a3c27-f3e7-4798-918e-f0be84a801ad admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:04.469181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284ba27-8416-4825-bee1-f7e1bb80b8f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:04.469796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ba27-8416-4825-bee1-f7e1bb80b8f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.470087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ba27-8416-4825-bee1-f7e1bb80b8f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.470369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ba27-8416-4825-bee1-f7e1bb80b8f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.479074 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284ba27-8416-4825-bee1-f7e1bb80b8f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:04.480558 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284ba27-8416-4825-bee1-f7e1bb80b8f4 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:04.490209 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1272/2552] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:04.506639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:04.552880 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:04.570151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c987e0-dd9b-40fd-b8b2-9adbf8602fa7 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:04.574681 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:04.575342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.575643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.575915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] PATH_INFO: `/v3/users/fc10b7c6f11f48759e1bd149c27bb376` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.577217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc10b7c6f11f48759e1bd149c27bb376)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:04.580439 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:04.735928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc10b7c6f11f48759e1bd149c27bb376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:04.806290 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc10b7c6f11f48759e1bd149c27bb376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:04.813820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc10b7c6f11f48759e1bd149c27bb376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:04.815662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc10b7c6f11f48759e1bd149c27bb376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:04.815662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc10b7c6f11f48759e1bd149c27bb376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:04.833384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1281/2553] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:04 2022] DELETE /identity/v3/users/fc10b7c6f11f48759e1bd149c27bb376 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:04.838324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.838811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.839042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:04.859876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:04.861141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:04.923216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1273/2554] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:04.933107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:04.934537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:04.994742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719539c-7b24-4164-801a-eace7dca567e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:04.998706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c954-6065-4d78-aaaf-83f3f6a152f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:04.999326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c954-6065-4d78-aaaf-83f3f6a152f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:04.999608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c954-6065-4d78-aaaf-83f3f6a152f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:04.999883 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c954-6065-4d78-aaaf-83f3f6a152f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:05.009101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c954-6065-4d78-aaaf-83f3f6a152f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:05.010540 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c954-6065-4d78-aaaf-83f3f6a152f1 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:05.020273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1282/2555] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:05.455605 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:05.457354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:05.469619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3d8e-799a-4f4a-ba60-86439f2b7c7e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:05.474645 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:05.475495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:05.475899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:05.476287 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] PATH_INFO: `/v3/projects/e17bf09af8524fc7b8bd8509ef68f7eb` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:05.477692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17bf09af8524fc7b8bd8509ef68f7eb)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:05.479970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:05.602250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17bf09af8524fc7b8bd8509ef68f7eb', 'request_id': 'req-e41ab645-b3d7-4094-bc7e-fa836ba48b21'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:05.608548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17bf09af8524fc7b8bd8509ef68f7eb', 'request_id': 'req-e41ab645-b3d7-4094-bc7e-fa836ba48b21'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:05.613254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:05.619408 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17bf09af8524fc7b8bd8509ef68f7eb', 'request_id': 'req-e41ab645-b3d7-4094-bc7e-fa836ba48b21'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:05.709495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] The token cache is being invalidate because project e17bf09af8524fc7b8bd8509ef68f7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:05.709789 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:05.710471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e41ab645-b3d7-4094-bc7e-fa836ba48b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:05.712055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1274/2556] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:05 2022] DELETE /identity/v3/projects/e17bf09af8524fc7b8bd8509ef68f7eb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:05.717072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:05.717378 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:05.717658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:05.740628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:05.741890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:05.818026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1283/2557] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:05.826179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:05.826476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:05.826760 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:05.847588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:05.849099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:05.857554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1275/2558] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:05.863027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:05.875315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda4a98-9b7c-46f8-af9b-1df3d1b9e860 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:05.880308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:05.880968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:05.881252 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:05.881526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:05.882223 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:05.882573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:05.884181 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:05.886017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:05.897074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1284/2559] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:05.902063 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:05.912011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f069-4df6-4a59-9279-51383c3a610a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:05.916855 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:05.917458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:05.917747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:05.918021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:05.918703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:05.920633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:05.986374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1276/2560] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:05 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:05.990606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:06.001755 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9b82d-eede-4182-8bbd-05149900a686 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:06.058721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:06.059374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.059645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.059925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.060600 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:06.063316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:06.184980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1285/2561] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:05 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:06.189278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:06.199593 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db31a05-9aa7-4c3d-81b2-bd58db4e5a17 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:06.205152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:06.205763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.206042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.206313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.207029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:06.208771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:06.219939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1277/2562] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:06.223976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:06.235158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee538f-fac8-4df1-81b7-3c42ad854ca0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:06.239946 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce15da-5158-4672-871a-56492520cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:06.240501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce15da-5158-4672-871a-56492520cf58 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.240820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce15da-5158-4672-871a-56492520cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.241125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce15da-5158-4672-871a-56492520cf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.241878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce15da-5158-4672-871a-56492520cf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:06.246232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce15da-5158-4672-871a-56492520cf58 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:06.255385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1286/2563] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:06.259684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:06.270021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b596d-33b6-48ab-a7a7-4c472fb30c9b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:06.274585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:06.275166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.275450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.275726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] PATH_INFO: `/v3/projects/f11d3ac6f8c34b58bf73ac392cae98d3/users/5cc938600b7d4bf5b7ab6b2b5d818a08/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.290381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11d3ac6f8c34b58bf73ac392cae98d3, user_id=5cc938600b7d4bf5b7ab6b2b5d818a08, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:06.293067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:06.356340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1278/2564] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:06 2022] PUT /identity/v3/projects/f11d3ac6f8c34b58bf73ac392cae98d3/users/5cc938600b7d4bf5b7ab6b2b5d818a08/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:06.362392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.362701 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.362966 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.381773 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:06.382974 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:06.444077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1287/2565] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:06.454012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:06.455740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:06.516344 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab390d85-88dd-44d8-bbb4-b1b9f8090e3f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:06.519486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fc71d-dc35-4201-aebb-4f3f9eca4b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:06.524367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fc71d-dc35-4201-aebb-4f3f9eca4b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.524367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fc71d-dc35-4201-aebb-4f3f9eca4b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.524367 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fc71d-dc35-4201-aebb-4f3f9eca4b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.529618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fc71d-dc35-4201-aebb-4f3f9eca4b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:06.531705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fc71d-dc35-4201-aebb-4f3f9eca4b8c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:06.540987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1279/2566] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:06.864502 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:06.866023 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:06.923069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c966cd-2553-4baf-9d6d-94213f227088 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:06.926643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:06.927250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:06.927531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:06.927803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:06.929690 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:06.960625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:06.997525 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:06.999149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:07.009598 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1288/2567] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:08.020668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a24d4-c624-4778-b014-1fa174863767 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:08.021272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a24d4-c624-4778-b014-1fa174863767 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:08.021272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a24d4-c624-4778-b014-1fa174863767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:08.050608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a48a24d4-c624-4778-b014-1fa174863767 None None] MFA Rules not processed for user `5cc938600b7d4bf5b7ab6b2b5d818a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:08.051914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a48a24d4-c624-4778-b014-1fa174863767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:08.118231 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1280/2568] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:08.129485 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:08.139197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf50ad-954d-46a0-b9ea-19c740fc8a27 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:08.143495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:08.144198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:08.144578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:08.144941 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:08.171518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:08.174457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:08.184786 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1289/2569] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:09.957793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:09.958348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:09.958348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:09.977250 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] MFA Rules not processed for user `5cc938600b7d4bf5b7ab6b2b5d818a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:09.978447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:09.985471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1281/2570] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:10.221761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:10.231463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338bdea-3316-4df6-a9de-f1f8f354e2d3 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:10.235212 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:10.235817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:10.236102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:10.236377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:10.238255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:10.247814 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:10.249937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243746d-9008-4c0b-bd14-5d25aa2440bc service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:10.257994 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1290/2571] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:19.971843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:20.090642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:20.092100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:20.106797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996d305-c9be-4e87-bb91-798477b50207 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:20.112374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:20.113060 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:20.113343 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:20.113620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] PATH_INFO: `/v3/users/f4344539eb8f4719a137c4a164ac6002` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:20.114947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4344539eb8f4719a137c4a164ac6002)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:20.116908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:20.254419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=29 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:20.320946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4344539eb8f4719a137c4a164ac6002'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:20.321565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4344539eb8f4719a137c4a164ac6002'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:20.331695 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4344539eb8f4719a137c4a164ac6002'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:20.346758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4344539eb8f4719a137c4a164ac6002'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:20.347623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4344539eb8f4719a137c4a164ac6002'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:20.418950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1282/2572] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:20 2022] DELETE /identity/v3/users/f4344539eb8f4719a137c4a164ac6002 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:20.423867 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:20.424111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:20.424398 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:20.445003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:20.446316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:20.523925 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1291/2573] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:20.532256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:20.534148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:20.601801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e2ce0-97fa-4f86-93cc-af50b515e388 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:20.611699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c8455-5dd7-4673-88c7-c918db9f089a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:20.612335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c8455-5dd7-4673-88c7-c918db9f089a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:20.612626 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c8455-5dd7-4673-88c7-c918db9f089a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:20.612941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c8455-5dd7-4673-88c7-c918db9f089a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:20.628587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c8455-5dd7-4673-88c7-c918db9f089a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:20.630365 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c8455-5dd7-4673-88c7-c918db9f089a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:20.642290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1283/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:21.108436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:21.110319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:21.142113 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a6283-7f05-4ef1-bdd3-33d79441a49d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:21.154703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:21.158756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:21.159268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:21.159893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] PATH_INFO: `/v3/projects/ef9ff2f35c2e4eff989f646dce54dbe2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:21.161932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9ff2f35c2e4eff989f646dce54dbe2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:21.165217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:21.330191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9ff2f35c2e4eff989f646dce54dbe2', 'request_id': 'req-972280a8-0ab1-4916-9758-4db2dfb80514'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:21.341048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9ff2f35c2e4eff989f646dce54dbe2', 'request_id': 'req-972280a8-0ab1-4916-9758-4db2dfb80514'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:21.347165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9ff2f35c2e4eff989f646dce54dbe2', 'request_id': 'req-972280a8-0ab1-4916-9758-4db2dfb80514'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:21.424446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] The token cache is being invalidate because project ef9ff2f35c2e4eff989f646dce54dbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:21.424640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:21.425312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-972280a8-0ab1-4916-9758-4db2dfb80514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:21.427008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1292/2575] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:21 2022] DELETE /identity/v3/projects/ef9ff2f35c2e4eff989f646dce54dbe2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:21.432066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077950-4183-4d11-b27e-823c4047b890 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:21.432578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077950-4183-4d11-b27e-823c4047b890 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:21.432685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077950-4183-4d11-b27e-823c4047b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:21.453632 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-11077950-4183-4d11-b27e-823c4047b890 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:21.455724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-11077950-4183-4d11-b27e-823c4047b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:21.538982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1284/2576] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:21.546509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:21.546904 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:21.547190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:21.571971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:21.573246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:21.581798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1293/2577] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:21.586615 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077950-4183-4d11-b27e-823c4047b890 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:21.596976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077950-4183-4d11-b27e-823c4047b890 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:21.602982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:21.603715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:21.603916 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:21.604190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:21.604922 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:21.605256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:21.606841 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:21.620145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1285/2578] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:21.624613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:21.635117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a959a26-0fea-4734-b07a-1e7f336b229e None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:21.641299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:21.642795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:21.643327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:21.643673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:21.644457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:21.646676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:21.782140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1294/2579] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:21 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:21.787055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:21.792689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:21.798486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829577c4-c9c9-47d5-92a1-b2f9bf5a815c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:21.874877 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:21.875720 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:21.876594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:21.876913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:21.877690 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:21.879807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:21.986463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1286/2580] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:21 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:21.990330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:22.003217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1b17a-2c6b-4c3e-87ac-b4e72e653a80 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:22.008176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:22.008861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.009149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.009427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.010143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:22.011866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:22.023939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1295/2581] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:22.029183 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:22.038885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e54678-82d0-4b27-93a6-60fdb44fc7b8 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:22.043897 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:22.044532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.044844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.045124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.045836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:22.047437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:22.065763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1287/2582] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:22.066817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:22.083667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8801c-b32b-4792-823b-ff531fd7ed19 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:22.101623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f9c0-cd4b-4f23-b65a-4831b126792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:22.102472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f9c0-cd4b-4f23-b65a-4831b126792b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.102751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f9c0-cd4b-4f23-b65a-4831b126792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.105499 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f9c0-cd4b-4f23-b65a-4831b126792b admin admin] PATH_INFO: `/v3/projects/b15d25dae63742149cba12f1896b45af/users/0b802a4549e647ca8a2e34b6c927121f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.118939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f9c0-cd4b-4f23-b65a-4831b126792b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15d25dae63742149cba12f1896b45af, user_id=0b802a4549e647ca8a2e34b6c927121f, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:22.121640 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f9c0-cd4b-4f23-b65a-4831b126792b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:22.158958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:22.164113 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:22.173972 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e14c3-d446-41a8-aee1-6af3a9687477 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:22.178840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:22.179482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.179765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.180164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] PATH_INFO: `/v3/users/e33a7b94e9c04b0198eb7f2185e82ec0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.181406 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33a7b94e9c04b0198eb7f2185e82ec0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:22.183517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:22.218915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1296/2583] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:22 2022] PUT /identity/v3/projects/b15d25dae63742149cba12f1896b45af/users/0b802a4549e647ca8a2e34b6c927121f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:22.230879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.231170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.231449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.259594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] MFA Rules not processed for user `0b802a4549e647ca8a2e34b6c927121f`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:22.260847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:22.269497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:22.333171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1297/2584] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:22.346352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:22.347764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:22.409532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb844-f1d3-496a-89d3-69d2aaa6a232 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:22.413280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce069-4090-4d02-bc78-47723d779b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:22.413906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce069-4090-4d02-bc78-47723d779b8f service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.414188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce069-4090-4d02-bc78-47723d779b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.414467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce069-4090-4d02-bc78-47723d779b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.423762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce069-4090-4d02-bc78-47723d779b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:22.425482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce069-4090-4d02-bc78-47723d779b8f service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:22.432708 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33a7b94e9c04b0198eb7f2185e82ec0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:22.433478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33a7b94e9c04b0198eb7f2185e82ec0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:22.434360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1298/2585] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:22.445243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33a7b94e9c04b0198eb7f2185e82ec0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:22.452325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33a7b94e9c04b0198eb7f2185e82ec0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:22.453064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33a7b94e9c04b0198eb7f2185e82ec0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:22.536333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1288/2586] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:22 2022] DELETE /identity/v3/users/e33a7b94e9c04b0198eb7f2185e82ec0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:22.536902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.536902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.536902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.557086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:22.558645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:22.627039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1299/2587] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:22.639970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:22.642354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:22.713610 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79645-f71a-411d-a728-ef7dbada55cd admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:22.717295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:22.717920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:22.718205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:22.718564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:22.730724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:22.732318 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:22.743472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1289/2588] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:23.237570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:23.239095 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:23.254464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4107b5-4ea1-4b42-84c5-7051e30d440a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:23.257247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:23.257987 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:23.258342 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:23.258985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] PATH_INFO: `/v3/projects/9e5606a757ed41d695173636d2e289d1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:23.260871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5606a757ed41d695173636d2e289d1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:23.263833 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:23.389316 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5606a757ed41d695173636d2e289d1', 'request_id': 'req-ee2dd53c-da06-47a5-87e0-78587c6f40b3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.398188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5606a757ed41d695173636d2e289d1', 'request_id': 'req-ee2dd53c-da06-47a5-87e0-78587c6f40b3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.404950 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5606a757ed41d695173636d2e289d1', 'request_id': 'req-ee2dd53c-da06-47a5-87e0-78587c6f40b3'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.418489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:23.458349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] The token cache is being invalidate because project 9e5606a757ed41d695173636d2e289d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:23.458739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.459561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.461216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1300/2589] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:23 2022] DELETE /identity/v3/projects/9e5606a757ed41d695173636d2e289d1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:23.465315 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:23.475676 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4ff7-edd3-4efc-b8fd-34a07cfe32a8 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:23.535480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:23.536129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:23.536595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:23.536842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] PATH_INFO: `/v3/users/4dd0cc34726f478790647499be095316` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:23.537931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd0cc34726f478790647499be095316)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:23.539848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:23.670206 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:23.769482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd0cc34726f478790647499be095316'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.770327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd0cc34726f478790647499be095316'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.777233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd0cc34726f478790647499be095316'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.789422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd0cc34726f478790647499be095316'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.790077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-acfe2ae7-a81d-4c44-af6b-d0dd5ba2e9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd0cc34726f478790647499be095316'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:23.909793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1290/2590] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:23 2022] DELETE /identity/v3/users/4dd0cc34726f478790647499be095316 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:24.289007 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:24.294830 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:24.307233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dd53c-da06-47a5-87e0-78587c6f40b3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:24.371699 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:24.372467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:24.372882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:24.373224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] PATH_INFO: `/v3/projects/0bf126d0dd584b87b301134466d56593` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:24.374545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf126d0dd584b87b301134466d56593)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:24.376865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:24.492093 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf126d0dd584b87b301134466d56593', 'request_id': 'req-57c10aaa-81df-44c6-b79e-dadcb6963d17'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:24.502194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf126d0dd584b87b301134466d56593', 'request_id': 'req-57c10aaa-81df-44c6-b79e-dadcb6963d17'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:24.519868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf126d0dd584b87b301134466d56593', 'request_id': 'req-57c10aaa-81df-44c6-b79e-dadcb6963d17'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:24.600707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] The token cache is being invalidate because project 0bf126d0dd584b87b301134466d56593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:24.601019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:24.601645 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-57c10aaa-81df-44c6-b79e-dadcb6963d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:24.603221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1301/2591] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:24 2022] DELETE /identity/v3/projects/0bf126d0dd584b87b301134466d56593 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:24.608042 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:24.608540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:24.608638 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:24.629578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:24.630780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:24.690797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1291/2592] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:24.698550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:24.698845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:24.699123 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:24.719003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:24.720412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:24.728939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1302/2593] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:24.738963 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:24.748901 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce76143-13d1-498e-8fc0-cbaf600ca027 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:24.754317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:24.754937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:24.755347 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:24.755494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:24.756196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:24.756508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:24.758193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:24.770692 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1292/2594] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:24.775177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:24.785593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131d69-808c-44ac-a307-143c20e866d4 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:24.790605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:24.791229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:24.791491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:24.791764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:24.792422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:24.794333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:24.917848 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1303/2595] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:24 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:24.921739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:24.927294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:24.932572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844ff3-5dc4-4fc6-9e59-cb71e18b19e1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:24.994218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:24.994883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:24.995541 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:24.996083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:24.997458 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.003160 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.110210 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1293/2596] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:24 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:25.115769 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.127874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44859dd6-2d66-43e9-823f-7e02caa0f554 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.132664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.133311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.133644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.133917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.134635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.136227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.146979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1304/2597] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:25.151130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.162086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b86a28-4f89-4a23-b08c-1b7e573fc72b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.167056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bcb42-e587-436f-a4cd-122d5e21cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.167674 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bcb42-e587-436f-a4cd-122d5e21cf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.167957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bcb42-e587-436f-a4cd-122d5e21cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.168256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bcb42-e587-436f-a4cd-122d5e21cf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.169008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bcb42-e587-436f-a4cd-122d5e21cf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.170792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bcb42-e587-436f-a4cd-122d5e21cf84 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.182478 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1294/2598] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:25.190609 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.200529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f95e1-0ec0-4028-8777-5ff368b76b77 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.205936 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.206594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.206877 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.207148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] PATH_INFO: `/v3/projects/9dd9f3695adb4a81a45eeb461f9d5da4/users/c4fef3816074470b889fe9d96ef9eb7f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.223076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd9f3695adb4a81a45eeb461f9d5da4, user_id=c4fef3816074470b889fe9d96ef9eb7f, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.226017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.333673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1305/2599] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:25 2022] PUT /identity/v3/projects/9dd9f3695adb4a81a45eeb461f9d5da4/users/c4fef3816074470b889fe9d96ef9eb7f/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:25.345778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.346174 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.346456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.375175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] MFA Rules not processed for user `c4fef3816074470b889fe9d96ef9eb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:25.376567 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:25.445189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1295/2600] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:25.450101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.456619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:25.518354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c8cd-0268-4b01-817f-de866122d0a3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.523202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.523819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.524131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.524408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.525121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.527114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.633381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1306/2601] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:25 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:25.637554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.649094 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bcf0f-11a3-4441-8854-7ca9552a943b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.711223 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.711844 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.712126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.712404 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.713127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.715024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.779476 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:25.784772 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1296/2602] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:25 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:25.788976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.800828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1585c-c21f-4a7e-a224-fadef260afa1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.805648 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.806294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.806578 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.806854 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.807579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.809234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.821136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1307/2603] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:25.825622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.837661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9776fb-d64c-4882-8682-2c8520fdbbed admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:25.842456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:25.855876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:25.855876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:25.855876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] PATH_INFO: `/v3/projects/d439e7b2f96449f2973ce3820d2d28b4/users/d6fdd999822848f2858f54e101a67989/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:25.859920 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d439e7b2f96449f2973ce3820d2d28b4, user_id=d6fdd999822848f2858f54e101a67989, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:25.862660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:25.973715 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1297/2604] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:25 2022] PUT /identity/v3/projects/d439e7b2f96449f2973ce3820d2d28b4/users/d6fdd999822848f2858f54e101a67989/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:25.978041 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:25.988528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cf0e3-cdbf-461f-91dc-ca04c844103b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:26.045678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b664f2-e683-454a-81f4-95c5fa12a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:26.046214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b664f2-e683-454a-81f4-95c5fa12a7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.046523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b664f2-e683-454a-81f4-95c5fa12a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.046799 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b664f2-e683-454a-81f4-95c5fa12a7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.047571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b664f2-e683-454a-81f4-95c5fa12a7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:26.049845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b664f2-e683-454a-81f4-95c5fa12a7fe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:26.059542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1308/2605] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:26.064565 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:26.076864 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec876b-67ce-4b5c-92e8-8742e7447033 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:26.082549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:26.083446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.083848 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.084308 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] PATH_INFO: `/v3/projects/d439e7b2f96449f2973ce3820d2d28b4/users/d6fdd999822848f2858f54e101a67989/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.086941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d439e7b2f96449f2973ce3820d2d28b4, user_id=d6fdd999822848f2858f54e101a67989, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:26.090096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:26.113947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1298/2606] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:26 2022] PUT /identity/v3/projects/d439e7b2f96449f2973ce3820d2d28b4/users/d6fdd999822848f2858f54e101a67989/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:26.121752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.122136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.122413 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.152500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] MFA Rules not processed for user `d6fdd999822848f2858f54e101a67989`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:26.153763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:26.226328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:26.231857 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1309/2607] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:26.243843 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:26.246064 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:26.311400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44692d0-b629-41ad-8f4a-1f1e5e594879 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:26.316457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:26.317039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.317327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.317606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.329577 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:26.331545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:26.344411 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1299/2608] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:26.397094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:26.398655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:26.418717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:26.459068 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f78e1-a183-434c-a0d0-e12d52295ad3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:26.463187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:26.463917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.464266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.464608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.466741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:26.495854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21baab7-166a-4224-9258-8703b3dc5a74 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:26.501485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:26.502141 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.502426 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.502714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] PATH_INFO: `/v3/users/c4fef3816074470b889fe9d96ef9eb7f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.503913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fef3816074470b889fe9d96ef9eb7f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:26.505912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:26.538227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:26.539665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f7334-6887-47f6-8b2b-1f77fd7b230d service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:26.550031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1310/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:26.665707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fef3816074470b889fe9d96ef9eb7f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:26.666292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fef3816074470b889fe9d96ef9eb7f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:26.673197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fef3816074470b889fe9d96ef9eb7f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:26.681205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:26.685905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fef3816074470b889fe9d96ef9eb7f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:26.699863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fef3816074470b889fe9d96ef9eb7f'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:26.813339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1300/2610] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:26 2022] DELETE /identity/v3/users/c4fef3816074470b889fe9d96ef9eb7f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:26.818074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.818358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.818630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.838087 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:26.839386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:26.904840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1311/2611] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:26.915227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:26.916718 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:26.976383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9c4c-76b9-44bd-ab1b-b2d879749cfe admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:26.980429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:26.981156 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:26.981484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:26.981784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:26.992433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:26.993981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:27.004587 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1301/2612] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:27.529104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:27.530433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:27.546747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6cb5b-71d4-4cc3-8228-c0e67e0e863a None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:27.552716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:27.554138 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:27.554336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:27.554676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] PATH_INFO: `/v3/projects/9dd9f3695adb4a81a45eeb461f9d5da4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:27.556071 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd9f3695adb4a81a45eeb461f9d5da4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:27.558367 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:27.690861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:27.694708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd9f3695adb4a81a45eeb461f9d5da4', 'request_id': 'req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:27.701890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd9f3695adb4a81a45eeb461f9d5da4', 'request_id': 'req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:27.718424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd9f3695adb4a81a45eeb461f9d5da4', 'request_id': 'req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:27.823621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] The token cache is being invalidate because project 9dd9f3695adb4a81a45eeb461f9d5da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:27.823940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:27.824544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:27.826159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1312/2613] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:27 2022] DELETE /identity/v3/projects/9dd9f3695adb4a81a45eeb461f9d5da4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:27.830940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:27.843457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e1f60-fa62-490e-b6da-a6505a75baff service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:27.903418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:27.903992 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:27.904281 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:27.904561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] PATH_INFO: `/v3/users/d6fdd999822848f2858f54e101a67989` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:27.905780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fdd999822848f2858f54e101a67989)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:27.907908 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:28.139484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fdd999822848f2858f54e101a67989'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:28.140143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fdd999822848f2858f54e101a67989'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:28.148502 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fdd999822848f2858f54e101a67989'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:28.161937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fdd999822848f2858f54e101a67989'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:28.162665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fdd999822848f2858f54e101a67989'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:28.257049 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1302/2614] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:27 2022] DELETE /identity/v3/users/d6fdd999822848f2858f54e101a67989 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:28.612597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:28.613224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:28.633039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ca71-cb05-4345-8c31-ba0d0d0e3eef admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:28.745702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:28.747422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:28.764652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:28.767514 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:28.768655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:28.769348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:28.769889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] PATH_INFO: `/v3/users/0b802a4549e647ca8a2e34b6c927121f` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:28.771734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b802a4549e647ca8a2e34b6c927121f)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:28.775465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:28.875018 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80c79c-a87f-4a44-b5c8-ae8f9663dc2d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:28.881155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:28.881969 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:28.882299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:28.882678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] PATH_INFO: `/v3/projects/d439e7b2f96449f2973ce3820d2d28b4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:28.884019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d439e7b2f96449f2973ce3820d2d28b4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:28.886139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:28.988416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b802a4549e647ca8a2e34b6c927121f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.016242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd439e7b2f96449f2973ce3820d2d28b4', 'request_id': 'req-adaa8557-a1dd-4379-b359-b39af6ea4c30'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.023449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd439e7b2f96449f2973ce3820d2d28b4', 'request_id': 'req-adaa8557-a1dd-4379-b359-b39af6ea4c30'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.029518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd439e7b2f96449f2973ce3820d2d28b4', 'request_id': 'req-adaa8557-a1dd-4379-b359-b39af6ea4c30'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.081072 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b802a4549e647ca8a2e34b6c927121f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.089392 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b802a4549e647ca8a2e34b6c927121f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.090175 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b802a4549e647ca8a2e34b6c927121f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.090817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-e7fe538d-96f6-4e94-950a-4ab038f7c1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b802a4549e647ca8a2e34b6c927121f'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.113129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1313/2615] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:28 2022] DELETE /identity/v3/users/0b802a4549e647ca8a2e34b6c927121f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:29.117576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.117862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.118136 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.137826 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:29.139108 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:29.179378 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] The token cache is being invalidate because project d439e7b2f96449f2973ce3820d2d28b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:29.179702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.180898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-adaa8557-a1dd-4379-b359-b39af6ea4c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:29.183096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1303/2616] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:28 2022] DELETE /identity/v3/projects/d439e7b2f96449f2973ce3820d2d28b4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:29.188271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a255c-7153-4898-8bc4-fb655611562e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.193568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a255c-7153-4898-8bc4-fb655611562e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.193568 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a255c-7153-4898-8bc4-fb655611562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.193774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:29.218752 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1314/2617] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:29.220087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a94a255c-7153-4898-8bc4-fb655611562e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:29.222286 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a94a255c-7153-4898-8bc4-fb655611562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:29.229418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.230847 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:29.250289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1304/2618] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:29.259214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.259862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.260136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.295976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:29.298057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:29.308976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291eced-651c-407e-b53c-a64dce052ec5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.311487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1305/2619] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:29.314736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.321652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.322486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.322837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.323180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.327989 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2305ab-e458-4589-8ce1-aaf8113c7e43 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.334011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.336858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.336858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.336858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.336858 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:29.337227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.339102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.342128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.343610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.359137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1306/2620] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:29.360624 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.364795 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1315/2621] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:29.370681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef94f3-dba7-426f-839d-e7ed5f48b3c0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.376770 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.377514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.377932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.378313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.379058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.381096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.520938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1307/2622] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:29 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:29.522075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.534519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5803-fea7-442f-95e0-ef7571558c54 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.619218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.619218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.619218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.619218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.620026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.620026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.687712 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1316/2623] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:29 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:29.692506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.706395 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d74a96-2233-4a46-af08-875bba11b6da admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.713503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.715101 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.715450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.715842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.718931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.721931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.736764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1308/2624] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:29.739566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.749978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6865f8-7786-4d62-a14d-d0f48bcf7526 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.755221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.755859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.756140 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.756414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.757146 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.758748 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.772977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1317/2625] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:29.785290 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.795728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bc56d-0d86-4136-88de-049185183756 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.801058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0f35-aecd-482c-b960-d0193b7043d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.801759 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0f35-aecd-482c-b960-d0193b7043d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.802053 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0f35-aecd-482c-b960-d0193b7043d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.802334 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0f35-aecd-482c-b960-d0193b7043d7 admin admin] PATH_INFO: `/v3/projects/b1137c2764d14b1e81b68677076e3159/users/1b5008227179471e8979544f3ba31381/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.818253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0f35-aecd-482c-b960-d0193b7043d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1137c2764d14b1e81b68677076e3159, user_id=1b5008227179471e8979544f3ba31381, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.821014 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0f35-aecd-482c-b960-d0193b7043d7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.843169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:29.848968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:29.867688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcc81f-b3a7-4fbb-aefe-f98c8f04e86b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:29.879832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:29.879832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.879832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.879832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] PATH_INFO: `/v3/projects/b15d25dae63742149cba12f1896b45af` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.880453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15d25dae63742149cba12f1896b45af)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:29.882635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:29.906783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1309/2626] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:29 2022] PUT /identity/v3/projects/b1137c2764d14b1e81b68677076e3159/users/1b5008227179471e8979544f3ba31381/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:29.918971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:29.919186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:29.919464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:29.955913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:29.960910 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] MFA Rules not processed for user `1b5008227179471e8979544f3ba31381`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:29.962342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:30.010381 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15d25dae63742149cba12f1896b45af', 'request_id': 'req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:30.019979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15d25dae63742149cba12f1896b45af', 'request_id': 'req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:30.028305 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15d25dae63742149cba12f1896b45af', 'request_id': 'req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:30.033531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:30.075052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1310/2627] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:30.082190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.182272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] The token cache is being invalidate because project b15d25dae63742149cba12f1896b45af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:30.182272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:30.183308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:30.193947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efda3a-974e-4121-825d-13fe8a2fa95e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.213843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1318/2628] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:29 2022] DELETE /identity/v3/projects/b15d25dae63742149cba12f1896b45af => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:30.284131 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.284827 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.285179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.285462 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.286162 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.288172 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.491374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1311/2629] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:30 2022] POST /identity/v3/projects => generated 381 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:30.491813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.493687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:30.516234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474b3fc-62f3-45c3-b7ae-10ec1299c87e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.577169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.578106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.578549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.579509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.580383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.582530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.662454 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1319/2630] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:30 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:30.663862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.674987 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b98b4d-b3f9-4b8d-b399-485b9982fb00 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.680526 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.681239 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.681528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.681806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.682509 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.684090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.698733 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1312/2631] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:30.703135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.715521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1bb9-9928-4115-8453-129bcaea11e0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.720326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.721254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.721537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.722025 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] PATH_INFO: `/v3/projects/db0f56ee5e9349c08702aa22491b565b/users/be452ae647d04a9f927f467925951be5/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.737955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f56ee5e9349c08702aa22491b565b, user_id=be452ae647d04a9f927f467925951be5, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.739986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.810896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1320/2632] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:30 2022] PUT /identity/v3/projects/db0f56ee5e9349c08702aa22491b565b/users/be452ae647d04a9f927f467925951be5/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:30.816998 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.836328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:30.840349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.877299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9cc3b-3ce3-4a05-9bb4-2140620ea2c4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.904511 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:30.912489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970670-1a0e-4331-b4a1-4b078de259e2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.917807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.918493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.918697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.918968 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.919665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.921886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.932432 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1321/2633] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:30.936777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:30.948357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.949195 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.949343 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca85d9-9d29-4434-a244-e4678168fce9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:30.951479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.951479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] PATH_INFO: `/v3/users/a1303857db364b2991017d1a39d8f3ce` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.951479 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1303857db364b2991017d1a39d8f3ce)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.953549 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.955205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee25f6-fed3-4a55-bd0d-f4e98e106def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:30.955978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee25f6-fed3-4a55-bd0d-f4e98e106def admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.956254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee25f6-fed3-4a55-bd0d-f4e98e106def admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.956535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee25f6-fed3-4a55-bd0d-f4e98e106def admin admin] PATH_INFO: `/v3/projects/db0f56ee5e9349c08702aa22491b565b/users/be452ae647d04a9f927f467925951be5/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:30.958587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee25f6-fed3-4a55-bd0d-f4e98e106def admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f56ee5e9349c08702aa22491b565b, user_id=be452ae647d04a9f927f467925951be5, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:30.961328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee25f6-fed3-4a55-bd0d-f4e98e106def admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:30.972265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1322/2634] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:30 2022] PUT /identity/v3/projects/db0f56ee5e9349c08702aa22491b565b/users/be452ae647d04a9f927f467925951be5/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:30.982729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:30.983016 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:30.983289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.011523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] MFA Rules not processed for user `be452ae647d04a9f927f467925951be5`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:31.012721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:31.048549 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:31.085174 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1323/2635] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:31.097382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:31.098730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:31.129167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1303857db364b2991017d1a39d8f3ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.129836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1303857db364b2991017d1a39d8f3ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.137214 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1303857db364b2991017d1a39d8f3ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.151851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1303857db364b2991017d1a39d8f3ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.152642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-566efef8-19c2-47f0-b9b7-44d1faa3dd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1303857db364b2991017d1a39d8f3ce'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.161376 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1298-b71c-4a3a-a810-1fde24ea802d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:31.165088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:31.165703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:31.165982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:31.166255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.168042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:31.179714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:31.181194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:31.191176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1324/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:31.207143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1313/2637] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:30 2022] DELETE /identity/v3/users/a1303857db364b2991017d1a39d8f3ce => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:31.449143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:31.450639 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:31.524811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a5061-ed10-4a82-8a7c-f3cb4d652093 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:31.584383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:31.585147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:31.585426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:31.585700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] PATH_INFO: `/v3/projects/970510efb0f540d8aefcc6199ea2ce5e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.586839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970510efb0f540d8aefcc6199ea2ce5e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:31.588887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:31.612952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:31.686903 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970510efb0f540d8aefcc6199ea2ce5e', 'request_id': 'req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.693704 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970510efb0f540d8aefcc6199ea2ce5e', 'request_id': 'req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.699126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970510efb0f540d8aefcc6199ea2ce5e', 'request_id': 'req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.764474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] The token cache is being invalidate because project 970510efb0f540d8aefcc6199ea2ce5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:31.764821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.765513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4dc32da1-a0e7-4918-aa52-7fb6e9bc5376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:31.767715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1325/2638] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:31 2022] DELETE /identity/v3/projects/970510efb0f540d8aefcc6199ea2ce5e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:31.772883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:31.773180 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:31.773464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.793322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:31.794534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:31.854924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1314/2639] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:31.865038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:31.865356 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:31.865688 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.886331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:31.887534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:31.896286 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1326/2640] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:31.900952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:31.910665 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b4455-6bb8-463a-856a-508f638999ad None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:31.915300 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:31.915909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:31.916194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:31.916468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.918938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:31.918938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:31.919205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:31.934967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1315/2641] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:31.936076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:31.946204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773a1ed-9d49-4eff-aa66-a318f9ab49a6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:31.950931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:31.951551 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:31.951832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:31.952105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:31.952902 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:31.955466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:31.988633 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:31.990393 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:32.031685 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1327/2642] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:31 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:32.036366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.107954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a6a47-941b-44fa-9f95-308578675989 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.113527 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.114204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.114670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.114955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.115632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.117628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.153350 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:32.183170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545caaaf-136a-4a38-87b7-380706d3e85e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.201127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1328/2643] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:32 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:32.207873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.218029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82480301-3099-468d-b491-fa09700f1350 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.222898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.223649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.223858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.224135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.224887 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.226862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.238214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1329/2644] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:32.242293 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.243078 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be452ae647d04a9f927f467925951be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0f56ee5e9349c08702aa22491b565b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.243787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.244108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.244376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.245110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:32.245414 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.250104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.252778 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd290-a479-40f2-91fa-9c9a7f02d7a9 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.257444 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.258040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.258322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.258597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.259383 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1316/2645] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:32.259494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.261165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.263293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.273386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0b9d4-31d4-41ea-b869-ae5b180d6038 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.274209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1330/2646] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:32.278106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be452ae647d04a9f927f467925951be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0f56ee5e9349c08702aa22491b565b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.278283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.278711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.278993 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.279317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.279968 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.282675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.290131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca92857-e1d3-4678-81ad-39531490a35b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.295738 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea84395-3c81-4e85-a6be-b8c4762eebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.296667 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea84395-3c81-4e85-a6be-b8c4762eebf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.296934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea84395-3c81-4e85-a6be-b8c4762eebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.297272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea84395-3c81-4e85-a6be-b8c4762eebf1 admin admin] PATH_INFO: `/v3/projects/0e6af6db42f647f88c7dd60e1dae0649/users/e333f6c792bb4fe891a90a1aaa71cf56/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.312649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea84395-3c81-4e85-a6be-b8c4762eebf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6af6db42f647f88c7dd60e1dae0649, user_id=e333f6c792bb4fe891a90a1aaa71cf56, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.315671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea84395-3c81-4e85-a6be-b8c4762eebf1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.373377 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1317/2647] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:32 2022] POST /identity/v3/projects => generated 354 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:32.377977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.396295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1331/2648] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:32 2022] PUT /identity/v3/projects/0e6af6db42f647f88c7dd60e1dae0649/users/e333f6c792bb4fe891a90a1aaa71cf56/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:32.407074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.407528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.407810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.443144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] MFA Rules not processed for user `e333f6c792bb4fe891a90a1aaa71cf56`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:32.444910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:32.446282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff78d2-2d6c-437d-9698-745fd603f910 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.459590 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:32.518448 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:32.521868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1332/2649] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:32.524463 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be452ae647d04a9f927f467925951be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0f56ee5e9349c08702aa22491b565b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.525129 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.525413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.525811 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.526537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:32.526845 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.528488 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.533354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.534638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:32.540765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1318/2650] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:32.582026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:32.591886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ce9e-8ed3-49f0-8d1a-30b8846801f2 tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.596562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be452ae647d04a9f927f467925951be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0f56ee5e9349c08702aa22491b565b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.597238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.597522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.597807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] PATH_INFO: `/v3/projects/e7f2ecb431194a9cb0cebf5f35f62d6c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.599001 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e7f2ecb431194a9cb0cebf5f35f62d6c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.601247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.617878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764e61b-cf9c-41e9-aa45-d2ea977c3fd3 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:32.627049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:32.627691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:32.628114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:32.628399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:32.636711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:32.638361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:32.647736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1333/2651] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:32.698295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f2ecb431194a9cb0cebf5f35f62d6c', 'request_id': 'req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:32.708778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f2ecb431194a9cb0cebf5f35f62d6c', 'request_id': 'req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:32.714932 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f2ecb431194a9cb0cebf5f35f62d6c', 'request_id': 'req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:32.773199 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] The token cache is being invalidate because project e7f2ecb431194a9cb0cebf5f35f62d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:32.773600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:32.774305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-36a90cb4-6613-4f7b-aa95-1a01f6a3ff0e tempest-VolumeQuotaClassesTest-1800120153 tempest-VolumeQuotaClassesTest-1800120153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:32.779328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1319/2652] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:32 2022] DELETE /identity/v3/projects/e7f2ecb431194a9cb0cebf5f35f62d6c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:33.352608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:33.352608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:33.419230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fb074-b61e-4d71-973a-9124898a57e7 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:33.465625 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:33.479271 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:33.479916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:33.480194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:33.480468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] PATH_INFO: `/v3/users/1b5008227179471e8979544f3ba31381` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:33.482059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5008227179471e8979544f3ba31381)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:33.484082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:33.661197 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5008227179471e8979544f3ba31381'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:33.720990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5008227179471e8979544f3ba31381'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:33.730324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5008227179471e8979544f3ba31381'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:33.731125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5008227179471e8979544f3ba31381'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:33.731817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5008227179471e8979544f3ba31381'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:33.749819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1334/2653] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:33 2022] DELETE /identity/v3/users/1b5008227179471e8979544f3ba31381 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:33.754986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:33.755464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:33.755562 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:33.775169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:33.776382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:33.836588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1320/2654] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:33.847520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:33.849077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:33.907758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded98b0-d226-418f-8479-28d6ea20b2b1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:33.912287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:33.913003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:33.913285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:33.914737 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:33.922576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:33.924669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:33.934700 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1335/2655] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:34.322500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:34.323962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:34.337038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593149e1-9c8d-428c-b2ed-c4e676881c32 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:34.341837 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:34.342480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:34.342758 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:34.343029 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] PATH_INFO: `/v3/projects/b1137c2764d14b1e81b68677076e3159` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:34.344232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1137c2764d14b1e81b68677076e3159)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:34.346782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:34.453189 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1137c2764d14b1e81b68677076e3159', 'request_id': 'req-81920d7a-dbde-4acd-b900-801f569e81cb'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.460093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1137c2764d14b1e81b68677076e3159', 'request_id': 'req-81920d7a-dbde-4acd-b900-801f569e81cb'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.468198 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1137c2764d14b1e81b68677076e3159', 'request_id': 'req-81920d7a-dbde-4acd-b900-801f569e81cb'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.534307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:34.539689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] The token cache is being invalidate because project b1137c2764d14b1e81b68677076e3159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:34.540215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.541107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.548173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1321/2656] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:34 2022] DELETE /identity/v3/projects/b1137c2764d14b1e81b68677076e3159 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:34.548417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:34.558894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab4853-0763-4044-840d-4431c0736c22 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:34.638062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:34.638706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:34.638988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:34.639263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] PATH_INFO: `/v3/users/be452ae647d04a9f927f467925951be5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:34.640437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=be452ae647d04a9f927f467925951be5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:34.642431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:34.655273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:34.878657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be452ae647d04a9f927f467925951be5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.938166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be452ae647d04a9f927f467925951be5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.946043 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be452ae647d04a9f927f467925951be5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.946671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be452ae647d04a9f927f467925951be5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.947276 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-6c945ac6-3246-41d5-8929-fb28f9b3f9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be452ae647d04a9f927f467925951be5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:34.964760 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1336/2657] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:34 2022] DELETE /identity/v3/users/be452ae647d04a9f927f467925951be5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:35.352566 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:35.354246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:35.370274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920d7a-dbde-4acd-b900-801f569e81cb admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:35.430840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:35.431413 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.431699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.431967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] PATH_INFO: `/v3/projects/db0f56ee5e9349c08702aa22491b565b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.433246 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0f56ee5e9349c08702aa22491b565b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:35.435137 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:35.532335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0f56ee5e9349c08702aa22491b565b', 'request_id': 'req-798391fd-6636-4b9d-b476-0bbf7eaf82f0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:35.538892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0f56ee5e9349c08702aa22491b565b', 'request_id': 'req-798391fd-6636-4b9d-b476-0bbf7eaf82f0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:35.544191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0f56ee5e9349c08702aa22491b565b', 'request_id': 'req-798391fd-6636-4b9d-b476-0bbf7eaf82f0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:35.600677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] The token cache is being invalidate because project db0f56ee5e9349c08702aa22491b565b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:35.601002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:35.601622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-798391fd-6636-4b9d-b476-0bbf7eaf82f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:35.603159 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1322/2658] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:35 2022] DELETE /identity/v3/projects/db0f56ee5e9349c08702aa22491b565b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:35.608092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.608550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.608643 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.628779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:35.629990 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:35.692694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1337/2659] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:35.700469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.700783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.701067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.720771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:35.722725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:35.730903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1323/2660] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:35.735035 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:35.744669 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64e785-df96-4cfe-9663-627a22351bd5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:35.749324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:35.749961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.750242 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.750518 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.751213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:35.751523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:35.753203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:35.765642 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1338/2661] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:35.770572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:35.779684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406b76-7608-46b6-8795-b5b6a6ef96e8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:35.784925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:35.785528 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.785818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.786092 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.786751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:35.788683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:35.834523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:35.834523 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:35.848334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1912a-0d49-4530-9fbf-5ff944b2eea2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:35.854082 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:35.854785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.855075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.855352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] PATH_INFO: `/v3/users/e333f6c792bb4fe891a90a1aaa71cf56` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.856541 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e333f6c792bb4fe891a90a1aaa71cf56)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:35.858563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:35.922977 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1324/2662] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:35 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:35.926719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:35.990017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9676a21-a53b-4b0b-bc4f-c47d5cfaed99 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:35.994783 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:35.995400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:35.995688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:35.995970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:35.996629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:35.998544 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.006662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:36.038300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e333f6c792bb4fe891a90a1aaa71cf56'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.103422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e333f6c792bb4fe891a90a1aaa71cf56'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.105293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1325/2663] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:35 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:36.108385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.111981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e333f6c792bb4fe891a90a1aaa71cf56'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.112747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e333f6c792bb4fe891a90a1aaa71cf56'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.113400 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-f104d034-9dd6-49da-881f-a0235bdfaee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e333f6c792bb4fe891a90a1aaa71cf56'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.118369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187265-fc20-4267-9e60-dc7e46fb45c0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.118829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:36.123080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.123684 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.123967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.124245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.125118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.126762 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.131299 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1339/2664] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:35 2022] DELETE /identity/v3/users/e333f6c792bb4fe891a90a1aaa71cf56 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:36.135717 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.136029 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.136319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.143182 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1326/2665] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:36.144915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.146726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:36.155918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:36.157128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:36.160487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c6fc-8912-4717-b344-fbff79c91e02 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.216084 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1340/2666] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:36.216721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.217481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.217761 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.218038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.218726 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.220380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.226576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.228005 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:36.232330 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1327/2667] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:36.236763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.246533 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd006b-eb18-4a95-a577-76f462abcc93 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.251149 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.251831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.252120 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.252399 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] PATH_INFO: `/v3/projects/0a127feb893e4b9da9ae56403127f1cc/users/41b53e14e4d24e1c836f4cb9b4d34df0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.267629 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a127feb893e4b9da9ae56403127f1cc, user_id=41b53e14e4d24e1c836f4cb9b4d34df0, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.271106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.285741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500ee7-b261-49cb-a907-7a6c13da5ca5 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.289449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbd569-966a-4c20-b972-583940e5d5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.290067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbd569-966a-4c20-b972-583940e5d5fa service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.290350 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbd569-966a-4c20-b972-583940e5d5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.290627 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbd569-966a-4c20-b972-583940e5d5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.299952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbd569-966a-4c20-b972-583940e5d5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.301463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbd569-966a-4c20-b972-583940e5d5fa service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.310865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1341/2668] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:36.344116 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1328/2669] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:36 2022] PUT /identity/v3/projects/0a127feb893e4b9da9ae56403127f1cc/users/41b53e14e4d24e1c836f4cb9b4d34df0/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:36.355695 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.355982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.356613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.386003 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] MFA Rules not processed for user `41b53e14e4d24e1c836f4cb9b4d34df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:36.387228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:36.451962 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1342/2670] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:36.456501 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.530796 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1342-bd1f-40c9-bab1-706c332c8a0a admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.535805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.536576 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.536951 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.537234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.538859 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.539895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.619535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1329/2671] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:36.623603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.635186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc96b-f355-41a1-8a8e-c39f2af35174 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.651723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:36.691715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.692359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.692818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.692927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.693574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.695495 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.700521 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.702217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:36.719885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd2ecb-3ec3-4690-8218-ca9b70601e5e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.727235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.728055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.728651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.729110 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] PATH_INFO: `/v3/projects/0e6af6db42f647f88c7dd60e1dae0649` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.731030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6af6db42f647f88c7dd60e1dae0649)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.733016 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.785135 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1343/2672] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:36 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:36.789160 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.798868 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a6051-e66d-4065-acbc-5b8a0839db4c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.804771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.805382 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.805670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.805949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.806679 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.808275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.818475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1344/2673] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:36.822519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.832067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfd68b-9e0e-4ad8-b8e0-2575dc054bfe admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:36.837115 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:36.837934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.838221 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.839457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] PATH_INFO: `/v3/projects/84b71cac857b4e47b6c3b40cbcdf8443/users/dff23bcd6abf4c97a0c9aec81ac069fe/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.840333 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:INSERT=5,keystone:SELECT=93,keystone:DELETE=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:36.853981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6af6db42f647f88c7dd60e1dae0649', 'request_id': 'req-583777b9-a754-4cb6-931f-46e3483a9606'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.855758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b71cac857b4e47b6c3b40cbcdf8443, user_id=dff23bcd6abf4c97a0c9aec81ac069fe, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:36.858871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:36.860685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6af6db42f647f88c7dd60e1dae0649', 'request_id': 'req-583777b9-a754-4cb6-931f-46e3483a9606'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.867065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6af6db42f647f88c7dd60e1dae0649', 'request_id': 'req-583777b9-a754-4cb6-931f-46e3483a9606'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.932027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] The token cache is being invalidate because project 0e6af6db42f647f88c7dd60e1dae0649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:36.932608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.933055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1345/2674] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:36 2022] PUT /identity/v3/projects/84b71cac857b4e47b6c3b40cbcdf8443/users/dff23bcd6abf4c97a0c9aec81ac069fe/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:36.936560 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-583777b9-a754-4cb6-931f-46e3483a9606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:36.936981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:36.938689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:36.938824 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1330/2675] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:36 2022] DELETE /identity/v3/projects/0e6af6db42f647f88c7dd60e1dae0649 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:36.943948 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495da75-2459-4a2d-a094-15a90ef05db2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:36.944314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495da75-2459-4a2d-a094-15a90ef05db2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:36.944698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495da75-2459-4a2d-a094-15a90ef05db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:36.973405 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8495da75-2459-4a2d-a094-15a90ef05db2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:36.975516 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8495da75-2459-4a2d-a094-15a90ef05db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:37.019481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a636a-3ba9-45c1-aad9-456e6bcc1b1d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.024167 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.024811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.025102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.025372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.026088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.027716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.038227 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1346/2676] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:37.042156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.044703 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1331/2677] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:37.052836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.052988 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f0746-0ed7-4cdc-9e9a-5365e6d052e8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.053117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.053425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.057557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007ba9f-36b9-4929-ba3a-edfca2e7fbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.058209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007ba9f-36b9-4929-ba3a-edfca2e7fbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.058494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007ba9f-36b9-4929-ba3a-edfca2e7fbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.058771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007ba9f-36b9-4929-ba3a-edfca2e7fbe7 admin admin] PATH_INFO: `/v3/projects/84b71cac857b4e47b6c3b40cbcdf8443/users/dff23bcd6abf4c97a0c9aec81ac069fe/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.060718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007ba9f-36b9-4929-ba3a-edfca2e7fbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b71cac857b4e47b6c3b40cbcdf8443, user_id=dff23bcd6abf4c97a0c9aec81ac069fe, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.063418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007ba9f-36b9-4929-ba3a-edfca2e7fbe7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.073534 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:37.074260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1347/2678] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:37 2022] PUT /identity/v3/projects/84b71cac857b4e47b6c3b40cbcdf8443/users/dff23bcd6abf4c97a0c9aec81ac069fe/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:37.074721 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:37.085143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.085431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.085706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.113825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] MFA Rules not processed for user `dff23bcd6abf4c97a0c9aec81ac069fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:37.115014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:37.136536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1332/2679] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:37.140839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.149663 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e7269-8164-43db-969f-b10aec7e1850 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.154272 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.154878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.155164 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.155443 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.156154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:37.156441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.158097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.161610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:37.170719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1333/2680] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:37.180400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.188918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1348/2681] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:37.194433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463c3e-d2e3-4aec-a557-0a292251c623 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.199328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.200002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.200287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.200468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.200584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.201280 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.201733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:37.203167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.260450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a23970-1c42-42e2-bd74-84a44d898c0f None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.264421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.265069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.265307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1334/2682] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:37 2022] POST /identity/v3/projects => generated 401 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:37.265418 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.265687 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.269896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.276798 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.278265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.288810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1349/2683] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:37.296984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:37.330163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02803bdb-7793-4c76-942f-588fd4e788fe admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.335622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.336242 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.336570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.336883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.337595 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.339527 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.436895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1335/2684] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:37 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:37.444101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.455109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643adaa3-fef0-4408-ad25-c20471b0aa08 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.460487 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.461231 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.461513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.461787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.462517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.464762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.475596 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1350/2685] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:37.484083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.494279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733d1-b362-4b4a-99ef-f33aa1da1e17 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.499642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056f482-71f3-4a80-a827-f539a982da85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.500247 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056f482-71f3-4a80-a827-f539a982da85 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.500525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056f482-71f3-4a80-a827-f539a982da85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.500909 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056f482-71f3-4a80-a827-f539a982da85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.501631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056f482-71f3-4a80-a827-f539a982da85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.503299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056f482-71f3-4a80-a827-f539a982da85 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.513468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1336/2686] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:37.521404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.528891 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d77d-95e3-49ff-b2a0-180f19c76f5d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.534816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.535466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.535744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.536017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] PATH_INFO: `/v3/projects/ed100b0fec1c48e38a98e02399e4c9b4/users/f1e6578521d24fdd93fcb75a7672ff51/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.681856 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed100b0fec1c48e38a98e02399e4c9b4, user_id=f1e6578521d24fdd93fcb75a7672ff51, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.683742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:37.738077 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1351/2687] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:37 2022] PUT /identity/v3/projects/ed100b0fec1c48e38a98e02399e4c9b4/users/f1e6578521d24fdd93fcb75a7672ff51/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:37.749433 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.749807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.750248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.779398 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] MFA Rules not processed for user `f1e6578521d24fdd93fcb75a7672ff51`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:37.780591 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:37.848678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1337/2688] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:37.853468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:37.915017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60ad35-e1e8-4635-b1f9-89c63668ef6b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:37.919597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:37.920199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:37.920474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:37.920813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:37.921421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:37.925873 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.134655 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1352/2689] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:37 2022] POST /identity/v3/projects => generated 403 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:38.138672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.149839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13be03-5cd1-4bc6-9561-c5a849ec1e85 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.209037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.209743 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.210096 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.210466 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.211191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.213118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.338299 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1338/2690] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:38 2022] POST /identity/v3/users => generated 308 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:38.342300 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.353920 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972bdb-fae6-4e65-8969-36093e03d0ca admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.358464 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.359076 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.359448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.359708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.360410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.362758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.374030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1353/2691] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:38.378486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.388931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0404bd-089c-4d30-b592-e4521d60894b admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.393672 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.394523 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.394809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.395087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] PATH_INFO: `/v3/projects/d4c963874435485296eb8ae62c363727/users/bd767b831cde428494f3f22460629b3a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.410524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c963874435485296eb8ae62c363727, user_id=bd767b831cde428494f3f22460629b3a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.413192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.522808 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:38.531201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1339/2692] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:38 2022] PUT /identity/v3/projects/d4c963874435485296eb8ae62c363727/users/bd767b831cde428494f3f22460629b3a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:38.533767 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.543475 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.544550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e9d69-5920-4714-8bca-4cbeb84e8d70 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.567436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:38.608186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.608840 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab5a74-d2ab-4eba-b93f-37ec7cd9fac0 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.608980 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.609125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.609433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.610126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.611721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.614487 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.614938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.615222 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.615499 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] PATH_INFO: `/v3/users/41b53e14e4d24e1c836f4cb9b4d34df0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.616681 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b53e14e4d24e1c836f4cb9b4d34df0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.618725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.622470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1354/2693] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:38.626550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.636875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ee55-d7e6-4bd5-8fb9-47e489776004 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.647984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668acf46-b42c-497e-9b68-cd51e5a48b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.647984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668acf46-b42c-497e-9b68-cd51e5a48b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.647984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668acf46-b42c-497e-9b68-cd51e5a48b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.647984 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668acf46-b42c-497e-9b68-cd51e5a48b05 admin admin] PATH_INFO: `/v3/projects/d4c963874435485296eb8ae62c363727/users/bd767b831cde428494f3f22460629b3a/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.648431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668acf46-b42c-497e-9b68-cd51e5a48b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c963874435485296eb8ae62c363727, user_id=bd767b831cde428494f3f22460629b3a, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.648431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668acf46-b42c-497e-9b68-cd51e5a48b05 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.657893 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1355/2694] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:38 2022] PUT /identity/v3/projects/d4c963874435485296eb8ae62c363727/users/bd767b831cde428494f3f22460629b3a/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:38.668408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.671056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.671056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.697184 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] MFA Rules not processed for user `bd767b831cde428494f3f22460629b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:38.698437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:38.764041 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b53e14e4d24e1c836f4cb9b4d34df0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:38.764747 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b53e14e4d24e1c836f4cb9b4d34df0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:38.768865 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1356/2695] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:38.775421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b53e14e4d24e1c836f4cb9b4d34df0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:38.780543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:38.790157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b53e14e4d24e1c836f4cb9b4d34df0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:38.790867 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-eaef8f4c-b759-4c94-bad4-8a3463400780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b53e14e4d24e1c836f4cb9b4d34df0'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:38.836805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efbae9-6dbc-4b90-a612-78f1a0de7815 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:38.845517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:38.852192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.852192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.852192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.852192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:38.861548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:38.863151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:38.874392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1340/2696] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:38 2022] DELETE /identity/v3/users/41b53e14e4d24e1c836f4cb9b4d34df0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:38.875649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1357/2697] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:38.877788 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:38.878103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:38.878457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:38.901661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:38.903517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:38.989090 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1341/2698] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:39.000389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:39.002014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:39.023228 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:39.025261 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:39.038785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5334-9c4f-469d-ab4f-d12b4bda3944 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:39.043545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:39.044207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:39.044494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:39.044809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] PATH_INFO: `/v3/users/f1e6578521d24fdd93fcb75a7672ff51` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:39.046093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e6578521d24fdd93fcb75a7672ff51)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:39.048011 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:39.052264 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:39.062884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:39.069375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529c1fa-0651-444a-88ee-2585e03a8277 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:39.118443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b5de2-1d15-4930-bf37-d1035ac12bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:39.119054 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b5de2-1d15-4930-bf37-d1035ac12bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:39.119331 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b5de2-1d15-4930-bf37-d1035ac12bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:39.119650 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b5de2-1d15-4930-bf37-d1035ac12bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:39.129187 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b5de2-1d15-4930-bf37-d1035ac12bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:39.130644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b5de2-1d15-4930-bf37-d1035ac12bb9 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:39.140322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1358/2699] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:39.260673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e6578521d24fdd93fcb75a7672ff51'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.261357 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e6578521d24fdd93fcb75a7672ff51'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.268099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e6578521d24fdd93fcb75a7672ff51'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.280652 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e6578521d24fdd93fcb75a7672ff51'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.281370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e6578521d24fdd93fcb75a7672ff51'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.390234 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1342/2700] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:39 2022] DELETE /identity/v3/users/f1e6578521d24fdd93fcb75a7672ff51 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:39.397846 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:39.398128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:39.398399 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:39.417496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:39.418626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:39.481147 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1359/2701] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:39.492382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:39.493817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:39.553552 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c5edb-4177-463e-944b-309ddd7f696e admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:39.557181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:39.557793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:39.558079 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:39.558358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:39.568455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:39.570134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:39.580810 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1343/2702] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:39.596326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:39.598172 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:39.614086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6c76a-ff9f-471f-854f-72a964c9b8bb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:39.627170 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:39.629447 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:39.629731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:39.630006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] PATH_INFO: `/v3/projects/0a127feb893e4b9da9ae56403127f1cc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:39.631250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a127feb893e4b9da9ae56403127f1cc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:39.640130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:39.750615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a127feb893e4b9da9ae56403127f1cc', 'request_id': 'req-caff9d63-9786-4acf-b85c-9ccc100d4d24'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.757505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a127feb893e4b9da9ae56403127f1cc', 'request_id': 'req-caff9d63-9786-4acf-b85c-9ccc100d4d24'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.763575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a127feb893e4b9da9ae56403127f1cc', 'request_id': 'req-caff9d63-9786-4acf-b85c-9ccc100d4d24'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.843450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] The token cache is being invalidate because project 0a127feb893e4b9da9ae56403127f1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:39.843450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.843723 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:39.845202 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1360/2703] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:39 2022] DELETE /identity/v3/projects/0a127feb893e4b9da9ae56403127f1cc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:39.850768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:39.861306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9437247-0ccd-4746-8176-8f58a6e5e186 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:39.921364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:39.922057 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:39.922336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:39.922608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] PATH_INFO: `/v3/users/dff23bcd6abf4c97a0c9aec81ac069fe` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:39.923797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff23bcd6abf4c97a0c9aec81ac069fe)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:39.926543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:40.095374 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:40.097937 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:40.110871 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9d63-9786-4acf-b85c-9ccc100d4d24 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:40.121073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:40.121073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:40.121073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:40.121073 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] PATH_INFO: `/v3/projects/ed100b0fec1c48e38a98e02399e4c9b4` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:40.121953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed100b0fec1c48e38a98e02399e4c9b4)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:40.121953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:40.132914 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:40.165915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:40.175237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff23bcd6abf4c97a0c9aec81ac069fe'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.175899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff23bcd6abf4c97a0c9aec81ac069fe'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.182596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff23bcd6abf4c97a0c9aec81ac069fe'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.194155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff23bcd6abf4c97a0c9aec81ac069fe'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.194801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff23bcd6abf4c97a0c9aec81ac069fe'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.275151 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed100b0fec1c48e38a98e02399e4c9b4', 'request_id': 'req-61433d1e-9190-4c58-bfb7-2760bdf39c8b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.275754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1344/2704] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:39 2022] DELETE /identity/v3/users/dff23bcd6abf4c97a0c9aec81ac069fe => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:40.281488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed100b0fec1c48e38a98e02399e4c9b4', 'request_id': 'req-61433d1e-9190-4c58-bfb7-2760bdf39c8b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.287726 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed100b0fec1c48e38a98e02399e4c9b4', 'request_id': 'req-61433d1e-9190-4c58-bfb7-2760bdf39c8b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.367619 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] The token cache is being invalidate because project ed100b0fec1c48e38a98e02399e4c9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:40.367926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.368554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.373228 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1361/2705] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:40 2022] DELETE /identity/v3/projects/ed100b0fec1c48e38a98e02399e4c9b4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:40.378040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:40.379551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:40.443196 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1bc1-7123-43be-8590-5e5f4b6e3e61 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:40.447852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:40.448491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:40.448862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:40.449140 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] PATH_INFO: `/v3/users/bd767b831cde428494f3f22460629b3a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:40.450294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd767b831cde428494f3f22460629b3a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:40.452245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:40.672306 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd767b831cde428494f3f22460629b3a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.673232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd767b831cde428494f3f22460629b3a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.680592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd767b831cde428494f3f22460629b3a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.696177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:40.700827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:40.707763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd767b831cde428494f3f22460629b3a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.708613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0580ccdd-b484-4fc4-b7fd-5478e6567336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd767b831cde428494f3f22460629b3a'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.774504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433d1e-9190-4c58-bfb7-2760bdf39c8b admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:40.779153 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:40.779784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:40.780060 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:40.780326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] PATH_INFO: `/v3/projects/84b71cac857b4e47b6c3b40cbcdf8443` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:40.781615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b71cac857b4e47b6c3b40cbcdf8443)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:40.783571 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:40.801722 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1345/2706] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:40 2022] DELETE /identity/v3/users/bd767b831cde428494f3f22460629b3a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:40.938774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b71cac857b4e47b6c3b40cbcdf8443', 'request_id': 'req-fb880337-272a-48ec-a6de-9c9ee210e41b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.945745 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b71cac857b4e47b6c3b40cbcdf8443', 'request_id': 'req-fb880337-272a-48ec-a6de-9c9ee210e41b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:40.951333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b71cac857b4e47b6c3b40cbcdf8443', 'request_id': 'req-fb880337-272a-48ec-a6de-9c9ee210e41b'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.041074 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] The token cache is being invalidate because project 84b71cac857b4e47b6c3b40cbcdf8443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:41.041510 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.042257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-fb880337-272a-48ec-a6de-9c9ee210e41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.044039 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1362/2707] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:40 2022] DELETE /identity/v3/projects/84b71cac857b4e47b6c3b40cbcdf8443 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:41.049320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.050186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.050471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.071124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:41.072338 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.098471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:41.133883 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1346/2708] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:41.141402 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.141797 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.142177 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.163545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:41.163545 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.171105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1363/2709] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:41.175937 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.185732 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5672-6db0-4972-b4c0-e01259af9ce9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.191089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.191698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.191982 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.192298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.193028 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:41.193335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.194919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.210282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1347/2710] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:41.211901 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.223106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf79a2-4d17-4be7-9f8f-6fae10e21f78 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.230416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.232933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.233051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.233163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.233163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.233163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.233438 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.234853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.247449 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c65ae-17fb-485e-967b-84b642850d8c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.255736 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.256550 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.256865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.257218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] PATH_INFO: `/v3/projects/d4c963874435485296eb8ae62c363727` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.258641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c963874435485296eb8ae62c363727)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.260571 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.339728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1364/2711] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:41.343741 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.348437 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:41.374491 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c963874435485296eb8ae62c363727', 'request_id': 'req-c2294b5c-5527-4b49-a75a-d9340a15bcff'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.381362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c963874435485296eb8ae62c363727', 'request_id': 'req-c2294b5c-5527-4b49-a75a-d9340a15bcff'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.387134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c963874435485296eb8ae62c363727', 'request_id': 'req-c2294b5c-5527-4b49-a75a-d9340a15bcff'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.404929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b69c8d-2857-43af-9a89-af9468b0fa67 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.435737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] The token cache is being invalidate because project d4c963874435485296eb8ae62c363727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:41.436080 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.436793 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-c2294b5c-5527-4b49-a75a-d9340a15bcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:41.438319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1348/2712] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:41 2022] DELETE /identity/v3/projects/d4c963874435485296eb8ae62c363727 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:41.443104 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4329f67-440a-4aca-8ff6-a17f3c9012a3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.443388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4329f67-440a-4aca-8ff6-a17f3c9012a3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.443664 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4329f67-440a-4aca-8ff6-a17f3c9012a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.462401 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.463022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.463303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.463574 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.463678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e4329f67-440a-4aca-8ff6-a17f3c9012a3 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:41.464247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.464915 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e4329f67-440a-4aca-8ff6-a17f3c9012a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.470013 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.473606 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1349/2713] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:41.481835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.492436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.492436 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.501898 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:41.503175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.511289 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1350/2714] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:41.515689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.524625 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69cc43-c042-44ef-b68b-6680f73eeca9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.529332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.529929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.530216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.530498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.531193 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:41.531497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.533114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.544173 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1365/2715] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:41.550260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1351/2716] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:41.550403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.550782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.551093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.561155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9eb4-9df1-4143-b0cd-6009433760fc admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.562315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6d31-1420-489f-b283-97a3f7533b4c admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.566123 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.566719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.566955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.567081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.567317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.567467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.567747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.567971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.568081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.568682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.569882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.570272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.580105 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1366/2717] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:41.584285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.593728 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c282c1-e1e1-40ff-a662-b545372cfdb0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.599470 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.604992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.604992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.604992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.604992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.604992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.613820 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1367/2718] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:41.617758 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.626827 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0ca7-28d5-4fd7-8b10-9fda34558529 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.631505 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.632118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.632394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.632660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] PATH_INFO: `/v3/projects/4c197a0fd8c54075a11e55245b17518a/users/bf01bf9e174e4f16bbf00f25e8bb28da/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.646626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c197a0fd8c54075a11e55245b17518a, user_id=bf01bf9e174e4f16bbf00f25e8bb28da, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.649260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.677144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1352/2719] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:41.681145 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.735068 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:41.745724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab793-c84e-44a3-8872-cc0e5912adf2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.750847 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bad9db-2c03-4ee1-9ed0-f0760e5ac0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.754620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bad9db-2c03-4ee1-9ed0-f0760e5ac0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.754620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bad9db-2c03-4ee1-9ed0-f0760e5ac0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.754620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bad9db-2c03-4ee1-9ed0-f0760e5ac0ed admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.754620 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bad9db-2c03-4ee1-9ed0-f0760e5ac0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.755304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bad9db-2c03-4ee1-9ed0-f0760e5ac0ed admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.763671 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1368/2720] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:41 2022] PUT /identity/v3/projects/4c197a0fd8c54075a11e55245b17518a/users/bf01bf9e174e4f16bbf00f25e8bb28da/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:41.832396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1353/2721] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:41.833310 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.835644 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.836602 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.836927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.871764 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] MFA Rules not processed for user `bf01bf9e174e4f16bbf00f25e8bb28da`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:41.873009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.889761 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:41.900539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfb6e-3ad2-47c7-9b79-55feca209497 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.905468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.906089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.906369 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.906644 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.907358 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.909550 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.919544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1369/2722] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:41.923465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.933296 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb03cfe-e95a-456d-8c00-8fd6a588895d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.937953 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.941730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.941730 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.941958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1354/2723] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:41.942058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.942058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.942058 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:41.951136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.952159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1370/2724] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:41.952890 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:41.957056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:41.967703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9d64-0517-477f-ac9d-40ffa004e5f0 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:41.973440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:41.974194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:41.974583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:41.974919 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] PATH_INFO: `/v3/projects/ce4819b1406944e787caa6acd2e305f1/users/d70910f4630d41dca0ef54cc4304fb83/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:41.990150 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4819b1406944e787caa6acd2e305f1, user_id=d70910f4630d41dca0ef54cc4304fb83, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:41.992809 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.012262 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6497f-f3b5-42cc-96c6-4b7f5d430686 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.015813 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bce722-b7a1-4109-83ff-bd4aba1f7dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.016482 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce722-b7a1-4109-83ff-bd4aba1f7dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.016780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce722-b7a1-4109-83ff-bd4aba1f7dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.017075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce722-b7a1-4109-83ff-bd4aba1f7dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.025724 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bce722-b7a1-4109-83ff-bd4aba1f7dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.027122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bce722-b7a1-4109-83ff-bd4aba1f7dc2 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.036735 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1355/2725] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:42.092189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1371/2726] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:41 2022] PUT /identity/v3/projects/ce4819b1406944e787caa6acd2e305f1/users/d70910f4630d41dca0ef54cc4304fb83/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:42.103960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.104245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.104520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.133097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] MFA Rules not processed for user `d70910f4630d41dca0ef54cc4304fb83`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:42.134292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:42.201340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1356/2727] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:42.206344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:42.270255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33b576-021f-4fb2-a250-27b5c8d9db72 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.276107 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.276915 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.277192 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.277460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.278119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.280148 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.390199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1372/2728] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:42 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:42.390380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:42.392237 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:42.397691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f63c-33a1-4f4e-b46a-f45f0f6b984f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.453461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.454076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.454362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.454636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.455304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.457348 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.567510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1357/2729] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:42 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:42.571558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:42.582101 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7352f-68f1-4f12-ac96-369e87efc3f7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.587448 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.588055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.588333 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.588604 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.589345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.590929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.601733 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1373/2730] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:42.605888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:42.616278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b75bd-347a-4bc1-8257-1eec2fd0dbb1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.621249 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.621907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.622190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.622467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] PATH_INFO: `/v3/projects/e941c28d5c064b8b8f39b35ed6e4ed42/users/171d5e7f8c304220a6c473b2a212df7c/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.637575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e941c28d5c064b8b8f39b35ed6e4ed42, user_id=171d5e7f8c304220a6c473b2a212df7c, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.640206 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.716536 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1358/2731] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:42 2022] PUT /identity/v3/projects/e941c28d5c064b8b8f39b35ed6e4ed42/users/171d5e7f8c304220a6c473b2a212df7c/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:42.720346 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:42.732777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094c6b7-3776-43d5-bad3-cd0d537200dd admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.795396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc997-c880-4fa5-a750-e40d73fbca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.796022 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc997-c880-4fa5-a750-e40d73fbca5d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.796302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc997-c880-4fa5-a750-e40d73fbca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.796638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc997-c880-4fa5-a750-e40d73fbca5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.797318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc997-c880-4fa5-a750-e40d73fbca5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.798918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc997-c880-4fa5-a750-e40d73fbca5d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.809493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1374/2732] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:42.813691 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:42.824213 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88033-b61e-4860-92f8-d54dd2c962ed admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:42.828926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd061-70bb-4c45-8bad-c4b6ea31ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:42.839048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd061-70bb-4c45-8bad-c4b6ea31ebea admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.839048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd061-70bb-4c45-8bad-c4b6ea31ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.839048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd061-70bb-4c45-8bad-c4b6ea31ebea admin admin] PATH_INFO: `/v3/projects/e941c28d5c064b8b8f39b35ed6e4ed42/users/171d5e7f8c304220a6c473b2a212df7c/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.839048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd061-70bb-4c45-8bad-c4b6ea31ebea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e941c28d5c064b8b8f39b35ed6e4ed42, user_id=171d5e7f8c304220a6c473b2a212df7c, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:42.839048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd061-70bb-4c45-8bad-c4b6ea31ebea admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:42.846307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1359/2733] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:42 2022] PUT /identity/v3/projects/e941c28d5c064b8b8f39b35ed6e4ed42/users/171d5e7f8c304220a6c473b2a212df7c/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:42.857493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.862042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.862042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.888224 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] MFA Rules not processed for user `171d5e7f8c304220a6c473b2a212df7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:42.890732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:42.901959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:42.919878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:42.920167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:42.920525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:42.941928 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:42.943707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:42.972557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1375/2734] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:42.980862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:43.008136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1360/2735] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:43.043232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31812cf0-6dce-490a-b50a-a53a816aaab2 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:43.045737 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:43.047112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:43.047559 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:43.048178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:43.048458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:43.048874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:43.060169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:43.061673 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:43.071789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1376/2736] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:43.108328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:43.130387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2c7d0-ed52-4a88-91f5-41ec8fe75198 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:43.138275 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7253a4e-e1c1-4e22-8696-e4c23cbce7e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:43.139291 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253a4e-e1c1-4e22-8696-e4c23cbce7e3 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:43.140051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253a4e-e1c1-4e22-8696-e4c23cbce7e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:43.140530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253a4e-e1c1-4e22-8696-e4c23cbce7e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:43.151702 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253a4e-e1c1-4e22-8696-e4c23cbce7e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:43.153854 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253a4e-e1c1-4e22-8696-e4c23cbce7e3 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:43.165564 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1361/2737] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:43.371821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:43.382691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e131528-cb13-4b4f-9858-d0a25a585c67 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:43.386558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:43.387253 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:43.387630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:43.388024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:43.453302 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:43.454779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:43.464504 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1377/2738] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:47.126481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:47.127054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:47.127054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:47.147857 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:47.149098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:47.157163 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1362/2739] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:47.185232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:47.186719 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:47.203446 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819639d-5493-440d-b35c-0434f8316b35 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:47.209089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667474-c414-4a16-9700-81f3e8ea1665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:47.209762 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667474-c414-4a16-9700-81f3e8ea1665 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:47.210694 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667474-c414-4a16-9700-81f3e8ea1665 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:47.210976 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667474-c414-4a16-9700-81f3e8ea1665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:47.219682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b667474-c414-4a16-9700-81f3e8ea1665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:47.221292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b667474-c414-4a16-9700-81f3e8ea1665 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:47.231458 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1378/2740] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:48.750941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:48.761362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a95e40-da74-483b-a7c0-8a0db81ef2cc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:48.766024 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:48.766636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:48.766921 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:48.767197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] PATH_INFO: `/v3/users/bf01bf9e174e4f16bbf00f25e8bb28da` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:48.768387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf01bf9e174e4f16bbf00f25e8bb28da)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:48.770326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:48.974851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf01bf9e174e4f16bbf00f25e8bb28da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:48.975775 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf01bf9e174e4f16bbf00f25e8bb28da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:48.982952 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf01bf9e174e4f16bbf00f25e8bb28da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:48.995392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf01bf9e174e4f16bbf00f25e8bb28da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:48.996038 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf01bf9e174e4f16bbf00f25e8bb28da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:49.069373 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1363/2741] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:48 2022] DELETE /identity/v3/users/bf01bf9e174e4f16bbf00f25e8bb28da => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:49.073940 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:49.074443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:49.074568 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:49.093345 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:49.094532 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:49.127593 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=100 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:49.153977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1379/2742] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:49.164007 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:49.165428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:49.221431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9691-20f6-48e8-826e-a287a0966c69 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:49.225870 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:49.226485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:49.226771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:49.227051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:49.236035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:49.237437 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:49.246884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1364/2743] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:49.620360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:49.622689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:49.635232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9feb-039e-464a-9524-1a3781fe57fb None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:49.640132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:49.640828 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:49.641112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:49.641394 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] PATH_INFO: `/v3/projects/4c197a0fd8c54075a11e55245b17518a` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:49.642575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c197a0fd8c54075a11e55245b17518a)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:49.644985 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:49.753243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:49.754594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:49.767525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b585c-249f-449b-9420-f1bffcbfe60c service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:49.772960 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:49.773608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:49.779093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:49.779093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] PATH_INFO: `/v3/users/d70910f4630d41dca0ef54cc4304fb83` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:49.779093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70910f4630d41dca0ef54cc4304fb83)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:49.779093 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:49.785433 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c197a0fd8c54075a11e55245b17518a', 'request_id': 'req-4a351474-c1f2-4022-9498-fa477b0ff4a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:49.792422 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c197a0fd8c54075a11e55245b17518a', 'request_id': 'req-4a351474-c1f2-4022-9498-fa477b0ff4a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:49.798288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c197a0fd8c54075a11e55245b17518a', 'request_id': 'req-4a351474-c1f2-4022-9498-fa477b0ff4a2'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:49.879992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] The token cache is being invalidate because project 4c197a0fd8c54075a11e55245b17518a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:49.880278 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:49.880942 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-4a351474-c1f2-4022-9498-fa477b0ff4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:49.882460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1380/2744] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:49 2022] DELETE /identity/v3/projects/4c197a0fd8c54075a11e55245b17518a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:49.889292 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99704-c323-434c-997e-c393263170f2 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:49.899512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99704-c323-434c-997e-c393263170f2 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:49.899512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac99704-c323-434c-997e-c393263170f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:49.910531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8ac99704-c323-434c-997e-c393263170f2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:49.912497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8ac99704-c323-434c-997e-c393263170f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:49.977635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1381/2745] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:49.985055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:49.985414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:49.986517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.006456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:50.007557 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.015935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1382/2746] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:50.020086 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.030011 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f6d0a-ccd3-4424-87c4-5ef7a4edd125 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.034710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.035304 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.035584 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.035858 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.037134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:50.037263 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:50.037478 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.039019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70910f4630d41dca0ef54cc4304fb83'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.039159 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.039754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70910f4630d41dca0ef54cc4304fb83'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.046971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70910f4630d41dca0ef54cc4304fb83'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.050998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1383/2747] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:46:50.055404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.060233 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70910f4630d41dca0ef54cc4304fb83'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.060984 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-ac162114-c4c5-4236-bebb-fc2d102d9e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70910f4630d41dca0ef54cc4304fb83'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.065548 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d1219-2e9a-4135-9f14-314758290ce7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.070311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.070930 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.071204 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.071472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.072128 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.074089 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.138370 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1365/2748] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:49 2022] DELETE /identity/v3/users/d70910f4630d41dca0ef54cc4304fb83 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:50.143033 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.143322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.143600 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.163056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:50.165283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.185508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1384/2749] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:50 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:50.189628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.191186 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.214297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:50.227329 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1366/2750] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:50.237979 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.239420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.261273 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e78b-cd1c-4587-9592-8f5bb3168519 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.266294 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.266898 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.267180 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.267453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.268120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.270097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.298146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1c530-e869-4557-9fa2-0b46da2b08c6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.351285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.354279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.354279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.354279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.357697 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1385/2751] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:50 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:50.361562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.364836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.366312 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.371918 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f989e-320f-4884-b2c4-baba402eb902 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.376138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1367/2752] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:50.376613 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.377256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.377543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.377817 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.378537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.380866 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.396312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1386/2753] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:50.397740 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.407599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3717f-66a3-4b95-8e54-3d3aa9d83920 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.412646 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccb4e1-6983-4844-8f6b-2d95473dce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.413295 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccb4e1-6983-4844-8f6b-2d95473dce83 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.413586 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccb4e1-6983-4844-8f6b-2d95473dce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.413866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccb4e1-6983-4844-8f6b-2d95473dce83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.414559 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccb4e1-6983-4844-8f6b-2d95473dce83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.416181 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccb4e1-6983-4844-8f6b-2d95473dce83 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.430304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1368/2754] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:50.431636 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.443031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42060d-36ea-447f-a105-8c49a6fd99c6 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.449056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.449766 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.450048 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.450375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] PATH_INFO: `/v3/projects/c51f2d45b4a54997bdf64822379160dd/users/8fabe436517546ec9a7ee5bdceaca1cc/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.466963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51f2d45b4a54997bdf64822379160dd, user_id=8fabe436517546ec9a7ee5bdceaca1cc, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.469672 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.555805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1387/2755] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:50 2022] PUT /identity/v3/projects/c51f2d45b4a54997bdf64822379160dd/users/8fabe436517546ec9a7ee5bdceaca1cc/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:50.561177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdee281-f56f-43ac-8968-3630d78e70e7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.561468 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdee281-f56f-43ac-8968-3630d78e70e7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.561757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdee281-f56f-43ac-8968-3630d78e70e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.582216 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ccdee281-f56f-43ac-8968-3630d78e70e7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:50.584056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ccdee281-f56f-43ac-8968-3630d78e70e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.589485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:50.660310 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1369/2756] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:50.670542 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.728067 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8dbf2-f46f-4301-8292-140751d5bbd8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.731842 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.732451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.732753 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.733040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.742415 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.743855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.748515 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.749168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.749651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.753676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1388/2757] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:50.775324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:50.775324 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.780677 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1370/2758] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:50.798774 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.802419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.802711 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:50.804270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:50.817118 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d9ca2-0d35-4409-9651-e0c5a4987071 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.832707 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.834235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.834464 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.834746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] PATH_INFO: `/v3/projects/ce4819b1406944e787caa6acd2e305f1` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.835957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4819b1406944e787caa6acd2e305f1)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.837935 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.887806 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b4c0-a6d4-430d-9d8b-e0fabaf91172 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:50.894145 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:50.894768 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:50.895049 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:50.895326 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:50.904641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:50.906416 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:50.917295 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1389/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:50.980265 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4819b1406944e787caa6acd2e305f1', 'request_id': 'req-f9ec3614-759d-4479-81ab-9477a1fc943d'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.986892 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4819b1406944e787caa6acd2e305f1', 'request_id': 'req-f9ec3614-759d-4479-81ab-9477a1fc943d'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:50.992782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4819b1406944e787caa6acd2e305f1', 'request_id': 'req-f9ec3614-759d-4479-81ab-9477a1fc943d'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.059194 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] The token cache is being invalidate because project ce4819b1406944e787caa6acd2e305f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:51.059486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.060903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.062779 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1371/2760] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:50 2022] DELETE /identity/v3/projects/ce4819b1406944e787caa6acd2e305f1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:51.066777 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:51.072230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:51.078746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d3e5-5ea2-4fd8-b467-4968b5895a27 service nova] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:51.140605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:51.141285 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:51.141563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:51.141837 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] PATH_INFO: `/v3/users/171d5e7f8c304220a6c473b2a212df7c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:51.143014 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171d5e7f8c304220a6c473b2a212df7c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:51.144960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:51.379081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171d5e7f8c304220a6c473b2a212df7c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.459110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171d5e7f8c304220a6c473b2a212df7c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.466397 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171d5e7f8c304220a6c473b2a212df7c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.467129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171d5e7f8c304220a6c473b2a212df7c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.467825 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-bd3cb3c6-84e5-4826-84f7-14f128e6c577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171d5e7f8c304220a6c473b2a212df7c'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:51.486861 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1390/2761] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:46:51 2022] DELETE /identity/v3/users/171d5e7f8c304220a6c473b2a212df7c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:52.020126 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.022269 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:52.036128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3614-759d-4479-81ab-9477a1fc943d admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.105486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.106048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.106335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.106619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] PATH_INFO: `/v3/projects/e941c28d5c064b8b8f39b35ed6e4ed42` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.107797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e941c28d5c064b8b8f39b35ed6e4ed42)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.109778 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:52.189325 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:52.202742 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e941c28d5c064b8b8f39b35ed6e4ed42', 'request_id': 'req-0a1c6242-06b7-4e61-ab41-3d3494da5613'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:52.210688 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e941c28d5c064b8b8f39b35ed6e4ed42', 'request_id': 'req-0a1c6242-06b7-4e61-ab41-3d3494da5613'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:52.217368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e941c28d5c064b8b8f39b35ed6e4ed42', 'request_id': 'req-0a1c6242-06b7-4e61-ab41-3d3494da5613'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:52.293763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] The token cache is being invalidate because project e941c28d5c064b8b8f39b35ed6e4ed42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:46:52.294099 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:52.295903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0a1c6242-06b7-4e61-ab41-3d3494da5613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:46:52.297846 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1372/2762] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:46:52 2022] DELETE /identity/v3/projects/e941c28d5c064b8b8f39b35ed6e4ed42 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:52.303689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.304218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.304218 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.324788 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:52.330094 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:52.401164 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1391/2763] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:52.402302 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.402753 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.407856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.463781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:52.465387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:52.474197 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1373/2764] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:52.478686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.490127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6c345-a492-4830-a5cf-5e7a97e51233 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.495106 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.495734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.496019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.499556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.499556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:46:52.499556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.499556 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:52.514004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1392/2765] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:46:52.518317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.530806 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c365e24-a42a-4441-a808-85eecd62e00a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.535925 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.537227 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.537578 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.537917 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.538682 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.540675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:52.671245 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1374/2766] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:52 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:52.672802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.683581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b98033-d5bd-42dd-9f88-c9f3ea7e751f admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.695884 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:52.749725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.750349 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.750635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.750913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.751588 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.753815 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:52.859324 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1393/2767] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:52 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:52.863866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.875700 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb565735-8888-48fe-90ed-abcb14699e96 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.880656 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.881510 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.881888 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.882259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.883270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.886073 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:52.901418 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1375/2768] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:52.904467 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.925716 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39512256-b098-4654-8d19-2615a422cc22 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.931482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a771-c191-4d55-b129-024b3deaeca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.932120 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a771-c191-4d55-b129-024b3deaeca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.932406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a771-c191-4d55-b129-024b3deaeca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.932684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a771-c191-4d55-b129-024b3deaeca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.933434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a771-c191-4d55-b129-024b3deaeca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.936366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a771-c191-4d55-b129-024b3deaeca5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:52.952621 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1394/2769] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:52.954179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:52.965554 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6686b2-c482-43d8-b5aa-63e7b38dc301 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:52.970722 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:52.976100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:52.976100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:52.976100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] PATH_INFO: `/v3/projects/a22dbc97ad13497cba7361525095f2f2/users/93b22dee6a324a2da7a48cf53f0ec6b2/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:52.993040 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22dbc97ad13497cba7361525095f2f2, user_id=93b22dee6a324a2da7a48cf53f0ec6b2, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:52.999320 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:53.106313 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1376/2770] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:52 2022] PUT /identity/v3/projects/a22dbc97ad13497cba7361525095f2f2/users/93b22dee6a324a2da7a48cf53f0ec6b2/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:53.114718 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5052-d347-4a31-8ab7-52de32fb9978 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:53.115102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5052-d347-4a31-8ab7-52de32fb9978 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:53.115536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5052-d347-4a31-8ab7-52de32fb9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:53.158615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-2e8e5052-d347-4a31-8ab7-52de32fb9978 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:53.158615 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2e8e5052-d347-4a31-8ab7-52de32fb9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:53.228047 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1395/2771] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:53.237782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:53.240349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:53.303432 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea6e19-bec0-4528-b6e9-ccdf5b44e595 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:53.307852 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:53.308585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:53.308905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:53.309179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:53.319573 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:53.321109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:53.331274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1377/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:53.672075 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2223-42a8-4c17-955d-1e84c51a0a2d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:53.672579 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2223-42a8-4c17-955d-1e84c51a0a2d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:53.672749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2223-42a8-4c17-955d-1e84c51a0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:53.702787 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-cead2223-42a8-4c17-955d-1e84c51a0a2d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:53.704971 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-cead2223-42a8-4c17-955d-1e84c51a0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:53.719169 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1396/2773] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:53.736217 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:53.737728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:53.804397 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:53.832106 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270aa77-3830-4139-9768-1776ad605e14 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:53.845298 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:53.845805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:53.846279 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:53.846585 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:53.857207 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:53.858891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:53.878008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1378/2774] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:46:55.118597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.119112 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.119200 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.160803 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] MFA Rules not processed for user `93b22dee6a324a2da7a48cf53f0ec6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:55.163214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:55.243864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1397/2775] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:55.248699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:55.267495 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242a38-436f-403a-8644-edcd0cba0485 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:55.274165 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:55.280285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.280285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.280285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.280285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:55.280285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:55.395048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1379/2776] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:55 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:55.399605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:55.416426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf80368-fcb7-4c7f-a14a-734ff7d76676 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:55.425410 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:55.485897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:55.486522 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.486807 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.487081 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.487746 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:55.490428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:55.632334 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1398/2777] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:55 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:55.640065 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:55.653385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d49f-5bfe-4cd1-8313-e3b6d87a126f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:55.664307 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:55.668912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.668912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.668912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.668912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:55.668912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:55.680651 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1380/2778] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:55.684479 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:55.699445 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b67f-b4d2-4e13-b380-9d19d5642d1e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:55.705234 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:55.707162 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.707612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.708638 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] PATH_INFO: `/v3/projects/d3c20466b8e046f7a603b02964e40d1b/users/5f0c14194b6d490fa819a8cb7099b259/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.737689 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c20466b8e046f7a603b02964e40d1b, user_id=5f0c14194b6d490fa819a8cb7099b259, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:55.741765 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:55.821100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1399/2779] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:55 2022] PUT /identity/v3/projects/d3c20466b8e046f7a603b02964e40d1b/users/5f0c14194b6d490fa819a8cb7099b259/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:55.825139 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:55.835799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8ae8e-4ec7-4e02-bd25-816786f70943 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:55.902232 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5609a-8e3d-4782-9ce9-b7ce543e1e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:55.902862 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5609a-8e3d-4782-9ce9-b7ce543e1e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.903144 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5609a-8e3d-4782-9ce9-b7ce543e1e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.903545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5609a-8e3d-4782-9ce9-b7ce543e1e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.904244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5609a-8e3d-4782-9ce9-b7ce543e1e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:55.906076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5609a-8e3d-4782-9ce9-b7ce543e1e62 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:55.918177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1381/2780] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:46:55.922111 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:55.934612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c10a-e7f3-4bcf-b8f6-f39ee2797279 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:55.944393 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:55.945116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:55.945395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:55.945668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] PATH_INFO: `/v3/projects/d3c20466b8e046f7a603b02964e40d1b/users/5f0c14194b6d490fa819a8cb7099b259/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:55.948496 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c20466b8e046f7a603b02964e40d1b, user_id=5f0c14194b6d490fa819a8cb7099b259, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:55.953125 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:55.974491 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1400/2781] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:55 2022] PUT /identity/v3/projects/d3c20466b8e046f7a603b02964e40d1b/users/5f0c14194b6d490fa819a8cb7099b259/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:56.606359 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42358-c575-4eb7-82ef-a5318ea8ac75 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:56.607081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42358-c575-4eb7-82ef-a5318ea8ac75 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:56.607081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42358-c575-4eb7-82ef-a5318ea8ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:56.645751 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7ac42358-c575-4eb7-82ef-a5318ea8ac75 None None] MFA Rules not processed for user `8fabe436517546ec9a7ee5bdceaca1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:56.648548 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7ac42358-c575-4eb7-82ef-a5318ea8ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:56.736891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1382/2782] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:46:56.741109 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:56.743544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:56.846057 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6139bc-2c19-4138-96ab-368163313972 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:56.854315 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:56.854954 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:56.855241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:56.855520 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:56.856205 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:56.858417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:56.934379 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1401/2783] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:46:56 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:46:56.938270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:56.938544 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:56.939130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:56.939598 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:56.963026 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:56.964637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:57.010086 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:57.010851 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:57.045929 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2b825-4b01-4b4c-a768-887514ac4f2e admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.056859 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.057497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.057781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.058198 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.059045 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.061488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.071319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1383/2784] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:57.092457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:57.094002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:57.167680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe15e85-160a-4ea0-9a4f-0bb89d09863e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.175015 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.175829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.176112 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.177814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.180220 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1402/2785] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:46:56 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:46:57.184583 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:57.187805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.189429 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.197453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e585c-de8d-452f-b434-fbbde68e1301 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.200107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1384/2786] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:46:57.202318 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83fd9-9afc-442e-b8af-3aa251f59377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.202945 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83fd9-9afc-442e-b8af-3aa251f59377 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.203229 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83fd9-9afc-442e-b8af-3aa251f59377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.203513 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83fd9-9afc-442e-b8af-3aa251f59377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.204207 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d83fd9-9afc-442e-b8af-3aa251f59377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.205916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d83fd9-9afc-442e-b8af-3aa251f59377 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.218821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1403/2787] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:57.223179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:57.237594 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df1c21-956c-4fba-8b35-8fa831dce5b6 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.253531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.255498 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.256990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.258905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] PATH_INFO: `/v3/projects/c39b4c7da9ef4431862b8876efa04e88/users/439538822fda450dad975ca9082d6da1/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.282658 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39b4c7da9ef4431862b8876efa04e88, user_id=439538822fda450dad975ca9082d6da1, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.285394 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.315998 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340e89c-6f27-46de-8b45-2280f1fa8508 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.316288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340e89c-6f27-46de-8b45-2280f1fa8508 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.317118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340e89c-6f27-46de-8b45-2280f1fa8508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.352061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1385/2788] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:57 2022] PUT /identity/v3/projects/c39b4c7da9ef4431862b8876efa04e88/users/439538822fda450dad975ca9082d6da1/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:46:57.352328 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-1340e89c-6f27-46de-8b45-2280f1fa8508 None None] MFA Rules not processed for user `5f0c14194b6d490fa819a8cb7099b259`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:57.355134 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1340e89c-6f27-46de-8b45-2280f1fa8508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:57.360961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:57.439293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583db15b-aa34-4232-9202-a528633c40c6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.444784 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.445496 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.445781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.446056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.446757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.448444 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.451461 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1404/2789] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:57.468959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42819418-8a11-443b-becb-d99b283dc37b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.469570 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42819418-8a11-443b-becb-d99b283dc37b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.470563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42819418-8a11-443b-becb-d99b283dc37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.472918 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1386/2790] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:46:57.475687 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:57.490630 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a1a1e-68cd-4131-ba63-2acc67edd1b6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.495263 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-42819418-8a11-443b-becb-d99b283dc37b None None] MFA Rules not processed for user `93b22dee6a324a2da7a48cf53f0ec6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:46:57.501749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.501749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.501749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.501749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] PATH_INFO: `/v3/projects/c39b4c7da9ef4431862b8876efa04e88/users/439538822fda450dad975ca9082d6da1/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.502783 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-42819418-8a11-443b-becb-d99b283dc37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:46:57.505940 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39b4c7da9ef4431862b8876efa04e88, user_id=439538822fda450dad975ca9082d6da1, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.508641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.523836 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1387/2791] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:46:57 2022] PUT /identity/v3/projects/c39b4c7da9ef4431862b8876efa04e88/users/439538822fda450dad975ca9082d6da1/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:46:57.574706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1405/2792] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:46:57.583520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:46:57.605863 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:57.661305 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392345-e0e1-4ba3-8d8c-75977358a85f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:46:57.668696 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:46:57.675243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:46:57.675243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:46:57.675243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:46:57.742524 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:46:57.744382 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:46:57.754076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1388/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:46:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:00.184425 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b28b-ded0-495c-af95-b423a3763086 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:00.185066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b28b-ded0-495c-af95-b423a3763086 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:00.185066 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b28b-ded0-495c-af95-b423a3763086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:00.210779 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e873b28b-ded0-495c-af95-b423a3763086 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:00.212319 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e873b28b-ded0-495c-af95-b423a3763086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:00.283603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:00.296528 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1406/2794] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:00.339467 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:00.355869 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb953-2218-4df9-991e-bd54fca74966 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:00.362260 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:00.362894 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:00.363175 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:00.363450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:00.374531 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:00.376335 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:00.388225 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1389/2795] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:03.714359 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c35d0-391d-48a1-90c2-032e035bb393 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:03.714917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c35d0-391d-48a1-90c2-032e035bb393 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:03.714917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c35d0-391d-48a1-90c2-032e035bb393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:03.759144 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-805c35d0-391d-48a1-90c2-032e035bb393 None None] MFA Rules not processed for user `439538822fda450dad975ca9082d6da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:03.760693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-805c35d0-391d-48a1-90c2-032e035bb393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:03.847329 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1407/2796] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:03.854981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:03.867364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307c10-7388-4a13-900d-0898f11e6000 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:03.873980 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:03.874914 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:03.875400 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:03.875907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:03.950750 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:03.953143 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:03.964525 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1390/2797] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:06.893622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901d2d-c986-4a64-a917-d665ceeccf2e None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:06.893622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901d2d-c986-4a64-a917-d665ceeccf2e None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:06.893622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901d2d-c986-4a64-a917-d665ceeccf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:06.919986 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0a901d2d-c986-4a64-a917-d665ceeccf2e None None] MFA Rules not processed for user `8fabe436517546ec9a7ee5bdceaca1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:06.921674 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0a901d2d-c986-4a64-a917-d665ceeccf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:06.956585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1408/2798] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:13.960346 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=81 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:15.401786 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:15.403584 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:15.461190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d34e-2f0d-4648-baff-7d90108dbe11 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:15.471058 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:15.472386 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:15.472773 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:15.473155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:15.548319 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:15.549787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:15.559285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1391/2799] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:16.904784 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=38 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:18.211199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54fe73-16d0-43d4-b39e-8845e19535cc None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:18.211802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54fe73-16d0-43d4-b39e-8845e19535cc None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:18.211802 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54fe73-16d0-43d4-b39e-8845e19535cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:18.233468 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0a54fe73-16d0-43d4-b39e-8845e19535cc None None] MFA Rules not processed for user `5cc938600b7d4bf5b7ab6b2b5d818a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:18.234841 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0a54fe73-16d0-43d4-b39e-8845e19535cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:18.298371 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1409/2800] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:21.848782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:21.848782 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:21.901754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b7046-9816-44ce-8fd9-3c4845fd454f service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:21.906385 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:21.906999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:21.907278 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:21.907551 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:21.909376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:21.919634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:21.921098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:21.929532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1392/2801] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:28.287706 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=25 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:31.925609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=76 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:34.046943 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650101-0de0-43fc-8f2d-1dc3e38d5c28 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:34.047576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650101-0de0-43fc-8f2d-1dc3e38d5c28 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:34.047576 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650101-0de0-43fc-8f2d-1dc3e38d5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:34.067423 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-79650101-0de0-43fc-8f2d-1dc3e38d5c28 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:34.068934 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-79650101-0de0-43fc-8f2d-1dc3e38d5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:34.076913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1410/2802] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:34.113183 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:34.147322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9473d6-4619-4a1a-8431-f1b823dbcf92 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:34.154757 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:34.155384 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:34.155667 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:34.155941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:34.166642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:34.168258 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:34.201188 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1393/2803] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:47:37.551839 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:37.553440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:37.553440 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:37.572829 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:37.574017 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:37.582194 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1411/2804] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:37.605098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:37.629285 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b19b7-92c6-4979-b51a-d19e49f69eb4 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:37.635967 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:37.636599 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:37.637012 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:37.637336 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:37.647596 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:37.649328 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:37.660360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1394/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:38.009926 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:38.011417 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:38.118493 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0aa2f-4cee-49cd-90a2-6ac0971e9ab8 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:38.124002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:38.124686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:38.124999 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:38.125275 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:38.127119 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:38.139734 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:38.141362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:38.153209 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1412/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:47:38.156471 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:38.173990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb7ea-d5e6-4da5-ae87-37c69dbbda5b service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:38.180022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:38.180649 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:38.183240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:38.183240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:38.195349 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:38.196906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:38.209791 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1395/2807] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:38.756956 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:38.771303 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e571a2-f7b3-432d-9002-15d644ddcc19 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:38.780426 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:38.781102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:38.781389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:38.781666 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:38.783554 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:38.796959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:38.798543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:38.808997 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1413/2808] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:38.998508 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:39.013161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be314a-bcba-4130-bcb0-43895db99510 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:39.018729 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:39.019381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:39.019763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:39.020048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] PATH_INFO: `/v3/users/93b22dee6a324a2da7a48cf53f0ec6b2` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:39.022866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b22dee6a324a2da7a48cf53f0ec6b2)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:39.024816 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:39.204938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b22dee6a324a2da7a48cf53f0ec6b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.205660 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b22dee6a324a2da7a48cf53f0ec6b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.214460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b22dee6a324a2da7a48cf53f0ec6b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.232604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b22dee6a324a2da7a48cf53f0ec6b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.233435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b22dee6a324a2da7a48cf53f0ec6b2'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.309860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1396/2809] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:47:38 2022] DELETE /identity/v3/users/93b22dee6a324a2da7a48cf53f0ec6b2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:39.627816 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:39.638862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50621e6c-a212-41b9-85e6-31babacdbda3 service placement] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:39.704320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:39.705009 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:39.705288 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:39.705561 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] PATH_INFO: `/v3/projects/a22dbc97ad13497cba7361525095f2f2` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:39.706721 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22dbc97ad13497cba7361525095f2f2)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:39.709020 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:39.833932 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:39.836691 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22dbc97ad13497cba7361525095f2f2', 'request_id': 'req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.842916 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22dbc97ad13497cba7361525095f2f2', 'request_id': 'req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.848749 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22dbc97ad13497cba7361525095f2f2', 'request_id': 'req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.964004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] The token cache is being invalidate because project a22dbc97ad13497cba7361525095f2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:47:39.964004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.964004 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-3a2aef99-de84-4d00-81bb-4cc65c4e6bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:39.964287 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1414/2810] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:47:39 2022] DELETE /identity/v3/projects/a22dbc97ad13497cba7361525095f2f2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:39.968154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:39.969634 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:39.985004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d058707-99fd-44ef-b1d4-d72b73a125f6 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:40.043944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:40.044650 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.044899 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.045183 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] PATH_INFO: `/v3/users/5f0c14194b6d490fa819a8cb7099b259` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.046376 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0c14194b6d490fa819a8cb7099b259)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:40.048293 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:40.070849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:40.241557 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0c14194b6d490fa819a8cb7099b259'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.242389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0c14194b6d490fa819a8cb7099b259'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.254102 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0c14194b6d490fa819a8cb7099b259'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.264483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0c14194b6d490fa819a8cb7099b259'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.268456 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0c14194b6d490fa819a8cb7099b259'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.320486 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1397/2811] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:47:39 2022] DELETE /identity/v3/users/5f0c14194b6d490fa819a8cb7099b259 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:40.457246 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.457872 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.458843 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.482977 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:40.491818 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.548719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:40.550431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.579114 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1415/2812] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:40.582080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:40.585512 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.611240 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc6ca3-83a2-427d-b3f5-5b9f266df6be None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:40.617203 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:40.618391 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.618781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.619536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] PATH_INFO: `/v3/projects/d3c20466b8e046f7a603b02964e40d1b` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.620967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c20466b8e046f7a603b02964e40d1b)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:40.622978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:40.673067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9fe7d-c061-4b5c-a528-e3d55cd15f63 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:40.679177 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:40.679882 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.680167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.680452 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.682254 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.695477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:40.697146 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:40.710114 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1398/2813] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:47:40.712243 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:40.713809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.735981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35ea7-7010-4f67-80a2-968f3cff0e40 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:40.750731 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c20466b8e046f7a603b02964e40d1b', 'request_id': 'req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.758927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c20466b8e046f7a603b02964e40d1b', 'request_id': 'req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.766764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c20466b8e046f7a603b02964e40d1b', 'request_id': 'req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.825500 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:40.827603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.827603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.827603 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.836787 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:40.853894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] The token cache is being invalidate because project d3c20466b8e046f7a603b02964e40d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:47:40.856312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.856312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-c9c95bfa-9f64-499a-953d-b8cb4d83c4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:40.859981 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1416/2814] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:47:40 2022] DELETE /identity/v3/projects/d3c20466b8e046f7a603b02964e40d1b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:40.862385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b134a-5055-4ba7-930c-cb17c1888b8b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.862675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b134a-5055-4ba7-930c-cb17c1888b8b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.862952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b134a-5055-4ba7-930c-cb17c1888b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.905641 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f20b134a-5055-4ba7-930c-cb17c1888b8b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:40.907907 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f20b134a-5055-4ba7-930c-cb17c1888b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.914087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:40.914457 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:40.922500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1417/2815] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:40.932436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:40.932742 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:40.933030 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:40.934938 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1399/2816] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:40.954938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:40.956163 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.968225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1418/2817] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:40.971944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:40.974988 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:40.992483 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ec8f-b380-4720-b602-9e4971485930 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:40.999109 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.000173 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.000805 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.001098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.001809 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:47:41.002121 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.003880 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.019107 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1400/2818] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:47:41.023906 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.034793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a7736-8046-4499-b449-2f60164ef921 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.041354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.041354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.041354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.041354 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.042213 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.044211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.123015 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1419/2819] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:47:41 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:47:41.128097 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.138390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aff75-247a-4ddc-9df5-30ae438873ea admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.197717 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.198342 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.198627 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.198907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.199574 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.201535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.281277 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1401/2820] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:47:41 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:47:41.285451 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.296450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822e0f-183e-4a31-8949-bab50a95610d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.301366 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.302143 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.302603 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.302894 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.303608 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.305322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.316040 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1420/2821] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:41.320673 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.331119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ab8c-c920-4f6d-b82a-681b395c10e1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.336543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139c4ec-f907-4b43-b5c9-706035971bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.337204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c4ec-f907-4b43-b5c9-706035971bad admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.337494 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c4ec-f907-4b43-b5c9-706035971bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.337776 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c4ec-f907-4b43-b5c9-706035971bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.338477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139c4ec-f907-4b43-b5c9-706035971bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.340084 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139c4ec-f907-4b43-b5c9-706035971bad admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.355103 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1402/2822] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:41.356327 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.366821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb0d4-0409-4c85-9df4-73b329c51e0d admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.371500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.372157 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.372438 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.372711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] PATH_INFO: `/v3/projects/014c522cda6441c89cc969c288d5694a/users/a0f6c70778f84da18e53fe338399731e/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.381661 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:41.388658 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014c522cda6441c89cc969c288d5694a, user_id=a0f6c70778f84da18e53fe338399731e, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.391395 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.527821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1421/2823] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:47:41 2022] PUT /identity/v3/projects/014c522cda6441c89cc969c288d5694a/users/a0f6c70778f84da18e53fe338399731e/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:41.595543 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.595831 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.596108 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.624503 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] MFA Rules not processed for user `a0f6c70778f84da18e53fe338399731e`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:41.626481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:41.695032 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:41.701039 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1403/2824] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:41.705387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.771831 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f412-3025-4a9a-926c-ef45bbf626a2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.776587 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.777259 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.777539 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.777813 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.778481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.780389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:41.870715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1422/2825] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:47:41 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:47:41.874887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:41.887446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40630d79-d9c1-4966-8f8b-7a5eaf496b48 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:41.953946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:41.954705 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:41.954990 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:41.955268 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:41.955939 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:41.957943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:42.023396 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1404/2826] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:47:41 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:47:42.027199 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:42.038100 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ff00-d3c9-40b7-b7ae-022d21211429 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:42.042722 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:42.043322 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:42.043605 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:42.043878 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:42.044562 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:42.046176 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:42.057132 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1423/2827] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:42.061205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:42.071316 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2614b-d424-4b27-919b-3ce0a7aebbdc admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:42.076076 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:42.076739 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:42.077037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:42.077322 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] PATH_INFO: `/v3/projects/be8f66ede1ab4b5fa719ab6c326e8d6f/users/8f169084cc8e47a2b73bfbb295761c88/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:42.091768 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8f66ede1ab4b5fa719ab6c326e8d6f, user_id=8f169084cc8e47a2b73bfbb295761c88, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:42.094469 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:42.149045 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1405/2828] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:47:42 2022] PUT /identity/v3/projects/be8f66ede1ab4b5fa719ab6c326e8d6f/users/8f169084cc8e47a2b73bfbb295761c88/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:42.152964 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:42.163494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ff1e-48a2-4183-ad6a-da69f2085748 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:42.218889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c06686-63f3-480d-96dc-8e136239e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:42.219509 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06686-63f3-480d-96dc-8e136239e3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:42.219793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06686-63f3-480d-96dc-8e136239e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:42.220069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06686-63f3-480d-96dc-8e136239e3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:42.220782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c06686-63f3-480d-96dc-8e136239e3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:42.222375 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c06686-63f3-480d-96dc-8e136239e3bb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:42.232581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1424/2829] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:42.236842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:42.247941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0582-753f-4f0d-8012-6239a3109f16 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:42.252589 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:42.253283 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:42.253572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:42.253853 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] PATH_INFO: `/v3/projects/be8f66ede1ab4b5fa719ab6c326e8d6f/users/8f169084cc8e47a2b73bfbb295761c88/roles/4cbefe0ba51848b9bc7724903bb75d4c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:42.256710 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8f66ede1ab4b5fa719ab6c326e8d6f, user_id=8f169084cc8e47a2b73bfbb295761c88, role_id=4cbefe0ba51848b9bc7724903bb75d4c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:42.259388 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:42.269893 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1406/2830] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:47:42 2022] PUT /identity/v3/projects/be8f66ede1ab4b5fa719ab6c326e8d6f/users/8f169084cc8e47a2b73bfbb295761c88/roles/4cbefe0ba51848b9bc7724903bb75d4c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:42.280330 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841690-1d20-4a21-abbb-ade1c5b93a5b None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:42.280575 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841690-1d20-4a21-abbb-ade1c5b93a5b None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:42.280882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841690-1d20-4a21-abbb-ade1c5b93a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:42.308678 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-86841690-1d20-4a21-abbb-ade1c5b93a5b None None] MFA Rules not processed for user `8f169084cc8e47a2b73bfbb295761c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:42.309913 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-86841690-1d20-4a21-abbb-ade1c5b93a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:42.355247 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:42.380756 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1425/2831] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:42.391895 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:42.393636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:42.455244 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cefff-01b6-422f-a1a3-1cd4cb7a1d94 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:42.459379 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:42.459973 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:42.460253 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:42.460530 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:42.520950 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:42.522460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:42.536506 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1407/2832] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:43.774481 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:43.774979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:43.774979 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:43.794543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:43.795931 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:43.860104 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1426/2833] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:43.881886 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:43.883421 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:43.890002 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:43.962314 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253caf-4706-41f6-a1ee-d899419c8cab service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:43.968008 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763e44-9a39-442e-8f25-1f779b771147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:43.968637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763e44-9a39-442e-8f25-1f779b771147 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:43.968961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763e44-9a39-442e-8f25-1f779b771147 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:43.969239 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763e44-9a39-442e-8f25-1f779b771147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:43.979754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763e44-9a39-442e-8f25-1f779b771147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:43.981459 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763e44-9a39-442e-8f25-1f779b771147 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:43.993970 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1408/2834] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:45.507928 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:45.517696 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c9377-2946-4025-bf19-33296dcf1bac None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:45.522325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:45.522959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:45.523241 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:45.523517 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] PATH_INFO: `/v3/users/a0f6c70778f84da18e53fe338399731e` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:45.524675 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f6c70778f84da18e53fe338399731e)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:45.526635 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:45.716019 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f6c70778f84da18e53fe338399731e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:45.771707 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f6c70778f84da18e53fe338399731e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:45.778991 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f6c70778f84da18e53fe338399731e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:45.779623 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f6c70778f84da18e53fe338399731e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:45.780298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f6c70778f84da18e53fe338399731e'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:45.797888 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1427/2835] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:47:45 2022] DELETE /identity/v3/users/a0f6c70778f84da18e53fe338399731e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:45.803187 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:45.808817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:45.808817 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:45.823446 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:45.827022 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:45.883797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1409/2836] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:45.893582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:45.894967 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:45.952812 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8d712-b290-473c-8b5c-e3ab43dd57d8 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:45.956443 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:45.957098 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:45.957384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:45.957660 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:45.966855 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:45.968280 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:45.972165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:45.979362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1428/2837] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:46.402061 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:46.403460 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:46.416387 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6c1de-e777-4e5b-85dc-8c57a49b9e0b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:46.421081 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:46.421865 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:46.422147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:46.422417 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] PATH_INFO: `/v3/projects/014c522cda6441c89cc969c288d5694a` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:46.423561 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=014c522cda6441c89cc969c288d5694a)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:46.425480 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:46.549166 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014c522cda6441c89cc969c288d5694a', 'request_id': 'req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.556117 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014c522cda6441c89cc969c288d5694a', 'request_id': 'req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.561622 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014c522cda6441c89cc969c288d5694a', 'request_id': 'req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.622929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] The token cache is being invalidate because project 014c522cda6441c89cc969c288d5694a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:47:46.623218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.623833 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.625355 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1410/2838] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:47:46 2022] DELETE /identity/v3/projects/014c522cda6441c89cc969c288d5694a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:46.629560 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:46.639308 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1874bb-8ad5-4416-ba97-b7fd31c2b376 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:46.693840 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:46.694406 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:46.694686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:46.694960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] PATH_INFO: `/v3/users/8f169084cc8e47a2b73bfbb295761c88` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:46.696124 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f169084cc8e47a2b73bfbb295761c88)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:46.698080 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:46.813508 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f169084cc8e47a2b73bfbb295761c88'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.886166 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f169084cc8e47a2b73bfbb295761c88'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.893659 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f169084cc8e47a2b73bfbb295761c88'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.895320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f169084cc8e47a2b73bfbb295761c88'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.895320 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-d3e0bfbe-4d61-4748-8e7f-01ea305f26af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f169084cc8e47a2b73bfbb295761c88'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:46.913546 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1429/2839] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:47:46 2022] DELETE /identity/v3/users/8f169084cc8e47a2b73bfbb295761c88 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:47.321422 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:47.322949 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:47.336390 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19b14-7cfc-47e3-b2c2-f16b7138d8db admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:47.346136 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:47.394240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:47.394874 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:47.395155 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:47.395505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] PATH_INFO: `/v3/projects/be8f66ede1ab4b5fa719ab6c326e8d6f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:47.396769 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8f66ede1ab4b5fa719ab6c326e8d6f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:47.398683 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:47.515130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8f66ede1ab4b5fa719ab6c326e8d6f', 'request_id': 'req-d2dbe675-d907-4522-9ac9-b1365b8c7493'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:47.522169 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8f66ede1ab4b5fa719ab6c326e8d6f', 'request_id': 'req-d2dbe675-d907-4522-9ac9-b1365b8c7493'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:47.527792 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8f66ede1ab4b5fa719ab6c326e8d6f', 'request_id': 'req-d2dbe675-d907-4522-9ac9-b1365b8c7493'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:47.577170 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] The token cache is being invalidate because project be8f66ede1ab4b5fa719ab6c326e8d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:47:47.577481 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:47.578087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d2dbe675-d907-4522-9ac9-b1365b8c7493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:47.579642 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1411/2840] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:47:47 2022] DELETE /identity/v3/projects/be8f66ede1ab4b5fa719ab6c326e8d6f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:47.585351 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:47.585686 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:47.585890 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:47.607178 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:47.608647 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:47.669529 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1430/2841] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:47.678538 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:47.678830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:47.679111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:47.698889 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:47.700111 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:47.708958 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1412/2842] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:47.713217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:47.725130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109bbb9-426a-4363-9ff6-797c8d47b08d None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:47.728693 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:47.729348 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:47.729632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:47.729978 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:47.730610 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:47:47.730917 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:47.732534 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:47.744819 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1431/2843] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:47:47.749473 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:47.759030 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde8ae-6ecd-4fa1-a889-6bf6b21507fb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:47.763754 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:47.764364 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:47.764648 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:47.764956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:47.765678 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:47.767522 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:47.859168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1413/2844] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:47:47 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:47:47.863536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:47.873260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:47.874235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127262f-fc01-4242-a3a7-9b10e41021d1 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:47.928963 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:47.929572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:47.929853 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:47.930130 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:47.931289 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:47.933750 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:48.046031 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1432/2845] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:47:47 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:47:48.050381 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:48.061100 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833390c-aace-40a9-acea-58fbd9581ffb admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:48.065820 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:48.066428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.066714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.066999 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.068304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:48.069926 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:48.079981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1414/2846] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:48.084535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:48.095117 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ffc76-40f0-4833-a9eb-3c58109da653 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:48.100268 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec8f4f-3c33-4b8d-9388-140e56a2aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:48.100911 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8f4f-3c33-4b8d-9388-140e56a2aa40 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.101190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8f4f-3c33-4b8d-9388-140e56a2aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.101460 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8f4f-3c33-4b8d-9388-140e56a2aa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.102156 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8f4f-3c33-4b8d-9388-140e56a2aa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:48.103771 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8f4f-3c33-4b8d-9388-140e56a2aa40 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:48.115372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1433/2847] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:48.119497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:48.129628 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0bec9-0f95-4adc-9277-e7187848e6ca admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:48.134912 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:48.135572 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.135903 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.136256 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] PATH_INFO: `/v3/projects/5b990030ccd242b0a7ea84b81afc6fd7/users/56ca8116071b468cb15147abc80c5cf5/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.151504 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b990030ccd242b0a7ea84b81afc6fd7, user_id=56ca8116071b468cb15147abc80c5cf5, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:48.154317 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:48.257957 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1415/2848] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:47:48 2022] PUT /identity/v3/projects/5b990030ccd242b0a7ea84b81afc6fd7/users/56ca8116071b468cb15147abc80c5cf5/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:47:48.268785 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.269083 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.269362 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.297472 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] MFA Rules not processed for user `56ca8116071b468cb15147abc80c5cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:48.298715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:48.364864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1434/2849] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:48.375835 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:48.377604 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:48.421631 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:48.435608 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dae1f6-03c7-4308-ae84-41b1e2c37bae admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:48.439427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff51bc4-5110-4b53-ae6d-36966038eb5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:48.440055 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff51bc4-5110-4b53-ae6d-36966038eb5d service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.440340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff51bc4-5110-4b53-ae6d-36966038eb5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.440618 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff51bc4-5110-4b53-ae6d-36966038eb5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.449441 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff51bc4-5110-4b53-ae6d-36966038eb5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:48.450866 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff51bc4-5110-4b53-ae6d-36966038eb5d service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:48.459771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1416/2850] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:48.484283 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:48.546614 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fa2c3-95e9-4ba4-be54-f53e01452451 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:48.551225 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:48.552427 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.552710 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.553010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] PATH_INFO: `/v3/users/56ca8116071b468cb15147abc80c5cf5` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.554188 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ca8116071b468cb15147abc80c5cf5)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:48.556110 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:48.569875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:48.807744 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ca8116071b468cb15147abc80c5cf5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:48.868428 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ca8116071b468cb15147abc80c5cf5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:48.875823 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ca8116071b468cb15147abc80c5cf5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:48.876456 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ca8116071b468cb15147abc80c5cf5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:48.877092 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ca8116071b468cb15147abc80c5cf5'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:48.895217 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1435/2851] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:47:48 2022] DELETE /identity/v3/users/56ca8116071b468cb15147abc80c5cf5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:48.900490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f681b3-2e92-4b99-acc2-5942b23da4a6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:48.900818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f681b3-2e92-4b99-acc2-5942b23da4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:48.901327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f681b3-2e92-4b99-acc2-5942b23da4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:48.921570 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-19f681b3-2e92-4b99-acc2-5942b23da4a6 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:48.922785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-19f681b3-2e92-4b99-acc2-5942b23da4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:48.984431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1417/2852] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:48.994469 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:48.995862 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:49.055000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dfd53-5e59-4890-a5ac-40a10a6c70d7 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:49.058789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:49.059355 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.059637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.059910 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.070725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:49.072165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:49.081751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1436/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:49.108497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.108815 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.109098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.129713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:49.131639 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:49.139803 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1418/2854] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 27 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:47:49.176386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:49.178581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:49.252793 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f94346-d644-40e2-8cbe-1fe7d4470472 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:49.259585 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9e91f-b591-4246-9763-4496e408c654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:49.260230 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9e91f-b591-4246-9763-4496e408c654 service nova] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.260526 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9e91f-b591-4246-9763-4496e408c654 service nova] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.261002 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9e91f-b591-4246-9763-4496e408c654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.269657 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9e91f-b591-4246-9763-4496e408c654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:49.271297 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9e91f-b591-4246-9763-4496e408c654 service nova] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:49.281232 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1437/2855] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:49.470345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:49.471943 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:49.486152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a824-7bf6-4fdc-8efb-393750a08be9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:49.492375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:49.493089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.493374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.493842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] PATH_INFO: `/v3/projects/5b990030ccd242b0a7ea84b81afc6fd7` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.495027 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b990030ccd242b0a7ea84b81afc6fd7)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:49.497043 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:49.600823 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b990030ccd242b0a7ea84b81afc6fd7', 'request_id': 'req-b045054c-0ea1-4e69-b8b6-40587a432f76'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:49.606971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b990030ccd242b0a7ea84b81afc6fd7', 'request_id': 'req-b045054c-0ea1-4e69-b8b6-40587a432f76'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:49.612961 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b990030ccd242b0a7ea84b81afc6fd7', 'request_id': 'req-b045054c-0ea1-4e69-b8b6-40587a432f76'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:49.708124 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] The token cache is being invalidate because project 5b990030ccd242b0a7ea84b81afc6fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:47:49.708450 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:49.709271 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b045054c-0ea1-4e69-b8b6-40587a432f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:47:49.710802 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1419/2856] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:47:49 2022] DELETE /identity/v3/projects/5b990030ccd242b0a7ea84b81afc6fd7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:47:49.719531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.719531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.719531 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.737377 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:49.738582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:49.752233 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:49.797804 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1438/2857] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:49.806613 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.806905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.807191 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.826830 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:49.828075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:49.836763 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1420/2858] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:49.841027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:49.851419 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ea5e-6247-467d-93a5-81d7eb540c71 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:49.855896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:49.856501 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.856805 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.857079 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.857764 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80327) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:47:49.858062 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:49.859663 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:49.871709 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1439/2859] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:47:49.875905 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:49.885368 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f23ae-a080-408c-8a5e-56b292d02ef2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:49.890077 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:49.890680 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:49.890959 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:49.891230 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:49.891891 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:49.893829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:49.979304 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1421/2860] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:47:49 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:47:49.983581 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:49.994260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ceee7-9d7f-49c3-9270-af12fcd623c2 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:50.049952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:50.050563 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:50.050845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:50.051118 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] PATH_INFO: `/v3/users` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:50.052389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:50.054383 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:50.143781 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1440/2861] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:47:49 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:47:50.150619 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:50.161532 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f3ba2-4375-49b9-b356-f74f79ef19e8 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:50.166192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:50.166804 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:50.167088 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:50.167363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:50.168051 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:50.169662 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:50.180179 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1422/2862] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:50.184032 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:50.194838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfd58-6709-41d2-bcfa-2a7d4d260ebb admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:50.199488 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed4711-0484-4524-80d0-4e90e4dd79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:50.200088 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed4711-0484-4524-80d0-4e90e4dd79c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:50.200373 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed4711-0484-4524-80d0-4e90e4dd79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:50.200652 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed4711-0484-4524-80d0-4e90e4dd79c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:50.201388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed4711-0484-4524-80d0-4e90e4dd79c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:50.202969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed4711-0484-4524-80d0-4e90e4dd79c2 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:50.213442 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1441/2863] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:47:50.217497 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:50.228241 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95c94-f849-45fb-b8e6-3749349a38f2 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:50.232971 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:50.236924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:50.236924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:50.236924 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] PATH_INFO: `/v3/projects/e88e9f1c03c846b4a500e33851fb5d6c/users/130a7b008cae4856a92386ec81f0f571/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:50.250520 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88e9f1c03c846b4a500e33851fb5d6c, user_id=130a7b008cae4856a92386ec81f0f571, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:50.253270 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:50.257257 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:50.331728 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1423/2864] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:47:50 2022] PUT /identity/v3/projects/e88e9f1c03c846b4a500e33851fb5d6c/users/130a7b008cae4856a92386ec81f0f571/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:47:50.343097 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:50.343389 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:50.343739 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:50.372664 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] MFA Rules not processed for user `130a7b008cae4856a92386ec81f0f571`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:47:50.373900 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:50.439708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1442/2865] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:47:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:47:50.450380 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:50.452130 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:50.510190 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14afb2a-1eb2-4f33-a9c7-c4964c88a327 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:50.514017 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:50.514693 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:50.514913 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:50.515192 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:50.524004 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:50.525461 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:50.534657 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1424/2866] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:47:59.775944 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:47:59.777436 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:59.796026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:59.847256 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159e141-d0a6-4d53-a7d4-7c7454a895c6 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:47:59.853628 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:47:59.854250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:47:59.854537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:47:59.854821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:47:59.856597 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:47:59.869042 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:47:59.870630 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f7fd0-5bdc-4fc5-8f85-e2dbcdb98904 service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:47:59.881594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1443/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:47:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:48:00.530431 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=28 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:01.621597 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:01.687442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80d2a-c5c2-4d9b-b6ee-5880985bd32e service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:01.691749 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:01.692420 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:01.692860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:01.693152 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] PATH_INFO: `/v3/users/130a7b008cae4856a92386ec81f0f571` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:01.694326 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130a7b008cae4856a92386ec81f0f571)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:01.696259 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:01.853709 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130a7b008cae4856a92386ec81f0f571'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:01.854363 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130a7b008cae4856a92386ec81f0f571'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:01.861157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130a7b008cae4856a92386ec81f0f571'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:01.873274 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130a7b008cae4856a92386ec81f0f571'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:01.873945 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130a7b008cae4856a92386ec81f0f571'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:01.948154 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1425/2868] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:48:01 2022] DELETE /identity/v3/users/130a7b008cae4856a92386ec81f0f571 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:01.952708 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:01.953191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:01.953363 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:01.972158 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:01.973384 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:02.031065 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1444/2869] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:02.041416 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:02.042856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:02.100205 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d5b9f-4326-432d-a5b7-787366b87185 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:02.103829 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b328e6-8a21-4e80-9273-360bd2c0d426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:02.104442 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b328e6-8a21-4e80-9273-360bd2c0d426 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:02.104719 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b328e6-8a21-4e80-9273-360bd2c0d426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:02.105020 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b328e6-8a21-4e80-9273-360bd2c0d426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:02.113849 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b328e6-8a21-4e80-9273-360bd2c0d426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:02.115282 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b328e6-8a21-4e80-9273-360bd2c0d426 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:02.124563 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1426/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:48:02.515896 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:02.517412 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:02.530266 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35fc42-52b2-427b-9c3b-5ff8377ad379 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:02.535063 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:02.535715 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:02.535992 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:02.536265 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] PATH_INFO: `/v3/projects/e88e9f1c03c846b4a500e33851fb5d6c` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:02.537676 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88e9f1c03c846b4a500e33851fb5d6c)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:02.539594 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:02.626149 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88e9f1c03c846b4a500e33851fb5d6c', 'request_id': 'req-9de60cb5-7e69-4b16-9a74-aad7f8022add'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:02.633189 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88e9f1c03c846b4a500e33851fb5d6c', 'request_id': 'req-9de60cb5-7e69-4b16-9a74-aad7f8022add'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:02.640434 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88e9f1c03c846b4a500e33851fb5d6c', 'request_id': 'req-9de60cb5-7e69-4b16-9a74-aad7f8022add'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:02.760424 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] The token cache is being invalidate because project e88e9f1c03c846b4a500e33851fb5d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80327) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:48:02.760714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:02.761361 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-9de60cb5-7e69-4b16-9a74-aad7f8022add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:02.762876 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1445/2871] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:48:02 2022] DELETE /identity/v3/projects/e88e9f1c03c846b4a500e33851fb5d6c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:02.768105 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:02.768609 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:02.768746 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:02.787953 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:02.789215 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:02.807447 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:02.853248 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1427/2872] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:02.861069 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:02.861429 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:02.861720 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:02.882969 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:02.884216 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:02.892390 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1446/2873] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:02.896689 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:02.906392 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ec7bd-e643-49be-8734-b752bf745ef7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:02.911128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:02.912255 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:02.912555 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:02.912876 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:02.913685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:48:02.914220 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:02.916659 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:02.931072 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1428/2874] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Jul 27 08:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:48:02.944935 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:02.954714 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e897a-7937-48fd-b97e-a0994f65fe60 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:02.960521 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:02.966126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:02.966126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:02.966126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:02.966126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:02.966126 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:03.058211 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:03.064558 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1447/2875] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Jul 27 08:48:02 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:48:03.069252 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:03.079339 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94cea-806c-42c0-955e-32ade039aef3 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:03.136389 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:03.136956 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:03.137240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:03.137518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:03.138186 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:03.140540 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:03.217505 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1429/2876] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Jul 27 08:48:03 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:48:03.221684 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:03.232357 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61a91-eb25-489f-a242-be72e6eaab9a admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:03.237281 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:03.237938 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:03.238222 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:03.238567 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:03.239262 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:03.241626 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:03.251582 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1448/2877] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:48:03.264801 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:03.275052 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdef04d-1849-4254-8f27-a522bca0a817 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:03.280161 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5c07-091a-4c22-b696-fb883e09c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:03.280797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5c07-091a-4c22-b696-fb883e09c765 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:03.281087 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5c07-091a-4c22-b696-fb883e09c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:03.281362 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5c07-091a-4c22-b696-fb883e09c765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:03.282054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5c07-091a-4c22-b696-fb883e09c765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:03.283654 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5c07-091a-4c22-b696-fb883e09c765 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:03.295059 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1430/2878] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Jul 27 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:48:03.299494 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:03.310311 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ecb3c-abdc-4c6e-b3af-799c26db18ed admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:03.315403 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:03.316055 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:03.316336 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:03.316612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] PATH_INFO: `/v3/projects/32b4da1cd3854abdbcd790245ea22b36/users/178cd4c2232f416e8fca15f69941a169/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:03.331489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b4da1cd3854abdbcd790245ea22b36, user_id=178cd4c2232f416e8fca15f69941a169, role_id=36a9e9a8bfa84bd9bb773e6fe52f0b49)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:03.334832 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:03.383059 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1449/2879] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Jul 27 08:48:03 2022] PUT /identity/v3/projects/32b4da1cd3854abdbcd790245ea22b36/users/178cd4c2232f416e8fca15f69941a169/roles/36a9e9a8bfa84bd9bb773e6fe52f0b49 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:03.394485 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c01d-c364-4bbb-b1f5-f5b929fe8928 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:03.394697 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c01d-c364-4bbb-b1f5-f5b929fe8928 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:03.394975 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675c01d-c364-4bbb-b1f5-f5b929fe8928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:03.426238 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8675c01d-c364-4bbb-b1f5-f5b929fe8928 None None] MFA Rules not processed for user `178cd4c2232f416e8fca15f69941a169`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:03.427493 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8675c01d-c364-4bbb-b1f5-f5b929fe8928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:03.494332 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1431/2880] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:03.507897 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:03.509698 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:03.566789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a1d5-7673-4c93-96f6-0ee76a372822 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:03.570489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f29724574eb4370a0f60e2a612401cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:03.571102 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:03.571380 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:03.571651 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:03.579763 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:03.581219 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:03.590591 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1450/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:48:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:48:05.383067 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:05.383592 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:05.383714 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:05.402661 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] MFA Rules not processed for user `178cd4c2232f416e8fca15f69941a169`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:05.403981 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:05.410941 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1432/2882] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:13.586732 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:15.397472 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:21.257404 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:21.258952 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:21.326387 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa5ad9-0604-4dca-9d93-d6150fdf61e2 service cinder] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:21.330821 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:21.331450 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:21.331729 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:21.332000 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] PATH_INFO: `/v3/users/5cc938600b7d4bf5b7ab6b2b5d818a08` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:21.333185 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc938600b7d4bf5b7ab6b2b5d818a08)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:21.336027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:21.499008 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc938600b7d4bf5b7ab6b2b5d818a08'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:21.566129 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc938600b7d4bf5b7ab6b2b5d818a08'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:21.574634 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc938600b7d4bf5b7ab6b2b5d818a08'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:21.577482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc938600b7d4bf5b7ab6b2b5d818a08'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:21.577482 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2013c213-217b-4398-9173-235617f10e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc938600b7d4bf5b7ab6b2b5d818a08'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:21.595649 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1451/2883] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:48:21 2022] DELETE /identity/v3/users/5cc938600b7d4bf5b7ab6b2b5d818a08 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:21.829122 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:21.842235 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c32cb-8ed6-42ad-8e9f-6aae23bfaa19 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:21.933545 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:21.934204 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:21.934490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:21.934765 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] PATH_INFO: `/v3/projects/f11d3ac6f8c34b58bf73ac392cae98d3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:21.935964 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11d3ac6f8c34b58bf73ac392cae98d3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:21.937887 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:22.046842 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11d3ac6f8c34b58bf73ac392cae98d3', 'request_id': 'req-642c4df6-dbec-4253-858f-556e4853b075'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:22.053157 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11d3ac6f8c34b58bf73ac392cae98d3', 'request_id': 'req-642c4df6-dbec-4253-858f-556e4853b075'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:22.058947 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11d3ac6f8c34b58bf73ac392cae98d3', 'request_id': 'req-642c4df6-dbec-4253-858f-556e4853b075'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:22.125839 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] The token cache is being invalidate because project f11d3ac6f8c34b58bf73ac392cae98d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:48:22.126138 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:22.126812 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:22.128425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1433/2884] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:48:21 2022] DELETE /identity/v3/projects/f11d3ac6f8c34b58bf73ac392cae98d3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:24.318236 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208972e-7389-46fc-a964-77fbb6c8375c None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:24.318895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208972e-7389-46fc-a964-77fbb6c8375c None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:24.318895 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208972e-7389-46fc-a964-77fbb6c8375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:24.338810 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-6208972e-7389-46fc-a964-77fbb6c8375c None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:24.340006 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-6208972e-7389-46fc-a964-77fbb6c8375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:24.395836 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1452/2885] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:24.540962 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:24.542369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:24.613054 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4df6-dbec-4253-858f-556e4853b075 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:24.618201 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:24.618814 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:24.619098 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:24.619374 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:24.627303 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:24.628931 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:24.636946 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1434/2886] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:25.463530 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f04bdb-cc53-4054-b9fd-5877686aedc0 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:25.464038 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f04bdb-cc53-4054-b9fd-5877686aedc0 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:25.464190 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f04bdb-cc53-4054-b9fd-5877686aedc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:25.488116 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-00f04bdb-cc53-4054-b9fd-5877686aedc0 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:25.489449 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-00f04bdb-cc53-4054-b9fd-5877686aedc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:25.496933 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1453/2887] 10.222.0.60 () {58 vars in 967 bytes} [Wed Jul 27 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:25.515607 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:25.529790 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501e5a-4d01-46f1-89ec-cd389d6c172d service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:25.535240 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:25.535860 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:25.536148 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:25.536428 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:25.545351 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:25.546929 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:25.557047 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1435/2888] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:26.147838 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7f68f-fcde-4e18-8ddd-d00c3feb7235 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:26.148131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7f68f-fcde-4e18-8ddd-d00c3feb7235 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:26.148431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7f68f-fcde-4e18-8ddd-d00c3feb7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:26.168010 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-31e7f68f-fcde-4e18-8ddd-d00c3feb7235 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:26.169171 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-31e7f68f-fcde-4e18-8ddd-d00c3feb7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:26.176214 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1454/2889] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Jul 27 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:26.188640 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:26.199153 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404fdac-0c21-4311-9019-a33ed186419b service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:26.204167 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:26.204794 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:26.205083 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:26.205369 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:26.210535 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:26.214066 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:26.215636 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:26.223641 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1436/2890] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:26.770489 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] REQUEST_METHOD: `POST` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:26.771483 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:26.771632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:26.791306 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.auth.core [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] MFA Rules not processed for user `832e2dbf7ce74ba6b43daf615a19a999`. Rule list: `[]` (Enabled: `True`). {{(pid=80327) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:26.792536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:26.799703 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1455/2891] 10.222.0.60 () {58 vars in 967 bytes} [Wed Jul 27 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:26.811878 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:26.822755 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab7abe-8401-4733-8d39-77582c564e69 service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:26.827885 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79c50-0c3f-4f31-a119-75edc3989f81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4612a994b4a481bac7f122c9ebe8405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:26.828489 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79c50-0c3f-4f31-a119-75edc3989f81 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:26.828807 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79c50-0c3f-4f31-a119-75edc3989f81 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:26.829089 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79c50-0c3f-4f31-a119-75edc3989f81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:26.837797 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79c50-0c3f-4f31-a119-75edc3989f81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:26.839425 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79c50-0c3f-4f31-a119-75edc3989f81 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:26.847637 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1437/2892] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Jul 27 08:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:29.362879 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:29.364250 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:29.370595 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:29.428372 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47056b-cf6c-4469-b847-017194d0e627 None None] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:29.433743 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:29.434396 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:29.434682 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:29.434959 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] PATH_INFO: `/v3/users/178cd4c2232f416e8fca15f69941a169` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:29.436133 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=178cd4c2232f416e8fca15f69941a169)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:29.443845 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:29.595573 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178cd4c2232f416e8fca15f69941a169'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:29.639500 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178cd4c2232f416e8fca15f69941a169'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:29.647298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178cd4c2232f416e8fca15f69941a169'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:29.650457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178cd4c2232f416e8fca15f69941a169'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:29.650457 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178cd4c2232f416e8fca15f69941a169'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:29.668414 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1456/2893] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:48:29 2022] DELETE /identity/v3/users/178cd4c2232f416e8fca15f69941a169 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:29.672976 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:29.673785 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:29.674119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:29.692919 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] MFA Rules not processed for user `7ba1e3f431c1414c8f4830c4c446296d`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:48:29.694147 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:29.755713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1438/2894] 10.222.0.60 () {58 vars in 958 bytes} [Wed Jul 27 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:48:29.765254 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:29.766662 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:29.827886 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6acd-d818-417b-b83a-dc3107792db3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:29.831566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:29.832191 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:29.832474 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:29.832875 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:29.843622 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:29.845298 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:29.856702 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1457/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:48:30.293818 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:48:30.295490 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:48:30.308580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a014890-b288-4fa5-9be1-7b4287c6de00 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:48:30.313668 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:48:30.314546 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:48:30.315009 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:48:30.315477 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] PATH_INFO: `/v3/projects/32b4da1cd3854abdbcd790245ea22b36` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:48:30.316906 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b4da1cd3854abdbcd790245ea22b36)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:48:30.319675 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:48:30.405345 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b4da1cd3854abdbcd790245ea22b36', 'request_id': 'req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:30.411354 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b4da1cd3854abdbcd790245ea22b36', 'request_id': 'req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:30.417021 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b4da1cd3854abdbcd790245ea22b36', 'request_id': 'req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:30.461725 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] The token cache is being invalidate because project 32b4da1cd3854abdbcd790245ea22b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:48:30.461944 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:30.462575 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:48:30.464292 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1439/2896] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:48:30 2022] DELETE /identity/v3/projects/32b4da1cd3854abdbcd790245ea22b36 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:48:39.852386 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:40.458514 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:38.891747 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:38.893165 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:38.905668 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dda40c-ac23-4e87-9f53-6beb71a0e867 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:38.956511 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:38.957182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:38.957463 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:38.957736 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:38.959543 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:39.028572 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:39.030027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:39.041519 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1458/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:49:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:49:40.226427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.226427 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:40.236372 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed2e42-fc43-4532-bf3d-df25a8f962d4 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.239930 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.240537 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.240856 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.241134 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.243340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:40.256455 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.258127 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.269125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1440/2898] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:49:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:49:49.035874 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=54 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.264221 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:53.540882 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:53.549725 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff25b7-e907-4be1-86a0-3692b742448d service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:53.553889 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:53.554475 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:53.554751 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:53.555026 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:53.557612 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:53.567850 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:53.569486 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:53.578629 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1459/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:49:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:49:53.659218 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:53.660927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:53.672451 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d17786-2f8f-45dd-8226-0d42d7c6246c service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:53.676119 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:53.676748 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:53.677044 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:53.677358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:53.679048 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:53.693360 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:53.694851 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:53.706434 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1441/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:49:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:50:03.575822 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:03.701208 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.357961 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.366535 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd69a-f2e3-4892-b582-3d88750b2036 service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.370344 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefebccee9e74e91a48485fa6f074698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.370949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.371226 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.371497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.373260 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:33.382632 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.384782 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.392606 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1460/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:50:43.389131 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=6 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:20.349340 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:20.350780 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:20.365341 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3cc57-a366-44d3-aed2-1d95e0505dc3 service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:20.371699 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb119ceb349f429aacde98d2940dde47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:20.372294 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:20.372580 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:20.372896 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:20.374623 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:20.386969 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:20.388713 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:20.400435 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1442/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:51:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:51:30.335637 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.339431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:30.395037 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:30.404056 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd755e-f545-444c-b7a8-6aa6050c4c6e service neutron] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.408580 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.409257 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.409537 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.409811 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] PATH_INFO: `/v3/users/8fabe436517546ec9a7ee5bdceaca1cc` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.411024 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fabe436517546ec9a7ee5bdceaca1cc)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.412927 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.570385 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fabe436517546ec9a7ee5bdceaca1cc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:30.637235 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fabe436517546ec9a7ee5bdceaca1cc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:30.644272 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fabe436517546ec9a7ee5bdceaca1cc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:30.644939 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fabe436517546ec9a7ee5bdceaca1cc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:30.645536 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fabe436517546ec9a7ee5bdceaca1cc'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:30.662955 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1461/2903] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:51:30 2022] DELETE /identity/v3/users/8fabe436517546ec9a7ee5bdceaca1cc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:30.953035 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.967927 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c3c9-76fc-4535-af31-dba6cf7fc0ee service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.031128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.031771 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.032056 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.032327 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] PATH_INFO: `/v3/projects/c51f2d45b4a54997bdf64822379160dd` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.033517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51f2d45b4a54997bdf64822379160dd)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.035582 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.138685 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51f2d45b4a54997bdf64822379160dd', 'request_id': 'req-e7be88f1-1a90-4954-8b72-da57922e1bab'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.144907 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51f2d45b4a54997bdf64822379160dd', 'request_id': 'req-e7be88f1-1a90-4954-8b72-da57922e1bab'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.150588 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51f2d45b4a54997bdf64822379160dd', 'request_id': 'req-e7be88f1-1a90-4954-8b72-da57922e1bab'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.218125 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] The token cache is being invalidate because project c51f2d45b4a54997bdf64822379160dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:51:31.218353 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.219006 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.220781 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1443/2904] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:51:30 2022] DELETE /identity/v3/projects/c51f2d45b4a54997bdf64822379160dd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:31.224949 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.226325 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:31.239864 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929af5d8-3b35-4041-b2a4-da5dd39f9144 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.296027 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.296670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.296982 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.297255 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] PATH_INFO: `/v3/users/439538822fda450dad975ca9082d6da1` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.298421 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439538822fda450dad975ca9082d6da1)` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.300352 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.322466 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.496127 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439538822fda450dad975ca9082d6da1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.551408 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439538822fda450dad975ca9082d6da1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.559312 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439538822fda450dad975ca9082d6da1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.559960 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439538822fda450dad975ca9082d6da1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.563465 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.notifications [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439538822fda450dad975ca9082d6da1'} {{(pid=80327) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.578360 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1462/2905] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Jul 27 08:51:31 2022] DELETE /identity/v3/users/439538822fda450dad975ca9082d6da1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:31.792986 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.798115 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:31.808128 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be88f1-1a90-4954-8b72-da57922e1bab admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.865873 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba1e3f431c1414c8f4830c4c446296d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f286f6bca46449aebb8b762b4e1748f9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.866517 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.866799 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.867075 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] PATH_INFO: `/v3/projects/c39b4c7da9ef4431862b8876efa04e88` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.868219 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39b4c7da9ef4431862b8876efa04e88)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.870375 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.944819 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.957518 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39b4c7da9ef4431862b8876efa04e88', 'request_id': 'req-b597799f-f5cb-426b-87ad-776b92ffe8a7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.966358 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39b4c7da9ef4431862b8876efa04e88', 'request_id': 'req-b597799f-f5cb-426b-87ad-776b92ffe8a7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:31.972484 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39b4c7da9ef4431862b8876efa04e88', 'request_id': 'req-b597799f-f5cb-426b-87ad-776b92ffe8a7'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:32.070019 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] The token cache is being invalidate because project c39b4c7da9ef4431862b8876efa04e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 08:51:32.070224 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:32.070884 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-b597799f-f5cb-426b-87ad-776b92ffe8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 08:51:32.073168 dv-cinder-851170-2-smb devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1444/2906] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Jul 27 08:51:31 2022] DELETE /identity/v3/projects/c39b4c7da9ef4431862b8876efa04e88 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:41.574789 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:42.231698 dv-cinder-851170-2-smb devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:34.947388 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Authenticating user token {{(pid=80327) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:34.949323 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:53:35.017665 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7074-d228-452f-9763-b0b5c41426d3 admin admin] Validating token access rules against request {{(pid=80327) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:35.076453 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2f62b5c7154b66841484f2c1f5cd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094706a52b994152a1b088b7bd48e068', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80327) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:35.077121 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] REQUEST_METHOD: `GET` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:35.077431 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] SCRIPT_NAME: `/identity` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:35.077711 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80327) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:35.079490 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.fernet_utils [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80327) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:53:35.091670 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:35.093566 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1d33f-ae95-4230-b4aa-ac24783240ef service placement] RBAC: Authorization granted {{(pid=80327) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:35.104497 dv-cinder-851170-2-smb devstack@keystone.service[80327]: [pid: 80327|app: 0|req: 1463/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Jul 27 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:53:45.099182 dv-cinder-851170-2-smb devstack@keystone.service[80327]: DEBUG dbcounter [-] [80327] Writing DB stats keystone:SELECT=58 {{(pid=80327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}